Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a limiter for pushing images #606

Open
sa02 opened this issue Nov 6, 2023 · 3 comments
Open

Add a limiter for pushing images #606

sa02 opened this issue Nov 6, 2023 · 3 comments
Labels
discussion This issue is not a bug or feature and a conversation is needed to find an appropriate resolution enhancement This issue is a feature request priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done.

Comments

@sa02
Copy link

sa02 commented Nov 6, 2023

In environments where multiple registries exist for the purpose of security with scan and promotion pipelines, imgpkg presents an issue where intermediate pipelines become overloaded due to the inability to properly stage.

Right now, we have a team pushing 300+ images to a pipeline that can handle 50 images at a time.

As a base solution, the ability to add a delay per image push would help significantly, in order to stagger the full deployment. Example below:

imgpkg push $IMAGE -d 10 
# -d = delay 
# 10 = 10 seconds

Vote on this request

This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.

👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"

We are also happy to receive and review Pull Requests if you want to help work on this issue.

@sa02 sa02 added carvel triage This issue has not yet been reviewed for validity enhancement This issue is a feature request labels Nov 6, 2023
Copy link

This issue is being marked as stale due to a long period of inactivity and will be closed in 5 days if there is no response.

@github-actions github-actions bot added the stale This issue has had no activity for a while and will be closed soon label Dec 17, 2023
@praveenrewar
Copy link
Member

@sa02 Apologies for missing this for so many days 😞
If I understand you issue correctly, imgpkg is being used concurrently to push 300+ images to the same registry and the registry can handle only 50 pushes at a time?

@praveenrewar praveenrewar reopened this Dec 26, 2023
@github-actions github-actions bot removed the stale This issue has had no activity for a while and will be closed soon label Dec 27, 2023
@renuy renuy added the priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. label Jan 2, 2024
Copy link

This issue is being marked as stale due to a long period of inactivity and will be closed in 5 days if there is no response.

@github-actions github-actions bot added the stale This issue has had no activity for a while and will be closed soon label Feb 12, 2024
@praveenrewar praveenrewar added discussion This issue is not a bug or feature and a conversation is needed to find an appropriate resolution and removed stale This issue has had no activity for a while and will be closed soon labels Feb 12, 2024
@renuy renuy removed the carvel triage This issue has not yet been reviewed for validity label Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion This issue is not a bug or feature and a conversation is needed to find an appropriate resolution enhancement This issue is a feature request priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done.
Projects
Status: Unprioritized
Development

No branches or pull requests

3 participants