Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Script to fetch unique conda environments #6659

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

ewels
Copy link
Member

@ewels ewels commented Sep 17, 2024

Script to go over all conda environment.yml files and pull out a unique, normalised set (consistent whitespace, no comments).

Will be useful when requesting initial set of Seqera Containers for all modules.

669 * 4 = 2,676 Wave builds we need to request 😅 (Docker, Singularity, arch, arm).

Not really intending to merge this in as we hopefully won't need it long term, just putting it here for reference / so I can find it again.

@ewels
Copy link
Member Author

ewels commented Sep 18, 2024

I started putting together a script to do a first pull + bulk update of all modules. It deliberately runs slowly, waiting for container builds, so as not to hit rate limits.

I started running but remembered that when we introduce Conda lock files we will need new builds for all of these, no point in doing it yet.

Needs a little more work to extend to singularity / arm but should be about ready once that's done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant