Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FR] Support parallel job execution #194

Open
NiklasRosenstein opened this issue Feb 5, 2024 · 0 comments
Open

[FR] Support parallel job execution #194

NiklasRosenstein opened this issue Feb 5, 2024 · 0 comments
Labels
only: kraken-core This issue affects only kraken-core. type: enhancement New feature or request

Comments

@NiklasRosenstein
Copy link
Contributor

Kraken currently executes only a single job at a time. Builds could most likely be sped up significantly by executing multiple jobs at the same time. We already model a DAG, and deriving which tasks can be executed in parallel based on that is trivial.

One thing we should keep in mind is formatters: When formatter tasks are not put into an explicit order by dependencies, they might already cause issues (e.g. black should run before isort). This may be aggravated by having formatters run in parallel.

Ideally the Kraken terminal output would show all currently running task names. When a task is complete, it immediately prints the output. Some tasks could require the terminal or should be run in foreground, for which we could introduce a flag on the Task class.

@NiklasRosenstein NiklasRosenstein added type: enhancement New feature or request only: kraken-core This issue affects only kraken-core. labels Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
only: kraken-core This issue affects only kraken-core. type: enhancement New feature or request
Projects
Status: No status
Development

No branches or pull requests

1 participant