DLS2 syntax

[pditommaso]

Interesting project! Have you considered to use DSL2 syntax?

It should make modules creation and composition much easier!

[anfederico]

Thanks! And yes I have, very excited to start using modules in other pipelines.

The only issue of using DLS2 here would be I need the modules/processes to be repeatable, as this is aimed more for modeling of large datasets rather than pre-processing.

Although, taking a second look at DSL2, I see this can be done through workflow composition, which is something I'll explore a bit more with this. It would definitely make the generated workflows much cleaner.