Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Errors getting pods crashing workflow #42

Open
ihodes opened this issue Sep 8, 2016 · 2 comments
Open

Errors getting pods crashing workflow #42

ihodes opened this issue Sep 8, 2016 · 2 comments
Labels
bug

Comments

@ihodes
Copy link
Member

ihodes commented Sep 8, 2016

Client.Response: URI: http://127.0.0.1:8082/job/describe?id=1ddb3227-d1ad-5ffb-8b57-fbc26e66fada, Meth: GET, Resp: ((encoding (Fixed 242)) (headers ((content-length 242))) (version HTTP_1_1)

Reason: "Error-from-coclobas: Updating failed 11 times: [ Shell-command failed:\nCommand:\n\nkubectl get pod 1ddb3227-d1ad-5ffb-8b57-fbc26e66fada -o=json\n\nStatus: Exited with 1\n\nStandard-output: empty.\n\nStandard-error:\n\nError from server: pods \"1ddb3227-d1ad-5ffb-8b57-fbc26e66fada\" not found\n\n ]"

Got this on a bunch (not all) of my jobs in a recent workflow on newest version of coclobas.
@ihodes ihodes added the bug label Sep 8, 2016
@ihodes
Copy link
Member Author

ihodes commented Sep 19, 2016

Still getting these, rarely, unfortunately.

smondet added a commit that referenced this issue Sep 21, 2016
@smondet
Allow some configuration of the server
d108972 
This allows to mitigate issues like #42 in environments where Kubernetes
can be a bit unreliable.
@smondet smondet mentioned this issue Sep 21, 2016
Merged
@smondet
Copy link
Member

smondet commented Oct 20, 2016

Did you try to bump the nb of retries since #50?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ihodes @smondet