Update CI workflow for pipelines

[adamrtalbot]

Description of feature

nf-core/fetchngs uses a new strategy based on scraping the information via Python to list and fetch all changed files, plus dependencies. It then lists all relevant nf-test files and uses them in a testing matrix.

ci.yml
Python script

We need to migrate this feature to the template. We should just be able to copy+paste the files.

nf-core/fetchngs#271
nf-core/fetchngs#300

[adamrtalbot]

Should be able to merge this after #2992 is merged

[mirpedrol]

Hi! Having a look at the way you test changed files and dependencies in fetchngs. Could we create an nf-core github action to avoid adding the python script to the pipeline template?

I was also wondering if this can be used in the modules repo. We want to test the subworkflows which use a module that has ben updated. Will this continue working if we completely remove tags?

[adamrtalbot]

Hi! Having a look at the way you test changed files and dependencies in fetchngs. Could we create an nf-core github action to avoid adding the python script to the pipeline template?

Already done! no tags required. We can probably switch this for the native nf-test feature but I haven't tried it yet.

[mirpedrol]

Hello, this seems to be solved, can I close the issue?