Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sporadic failure of screenshot tests #361

Closed
kushalkolar opened this issue Nov 3, 2023 · 1 comment
Closed

Sporadic failure of screenshot tests #361

kushalkolar opened this issue Nov 3, 2023 · 1 comment

Comments

@kushalkolar
Copy link
Member

Yesterday I started noticing failure of only one random job in our build matrix sometimes. The job passes if it's re-run without making any changes. It's really bizarre, the following are identical between the runs:

  • the runner image and version
  • OS, OS version
  • apt packages, llvmpipe etc.
  • pip installed packages
  • wgpu backend

Failed job log: https://github.com/fastplotlib/fastplotlib/actions/runs/6741145455/job/18325292316?pr=351

Re-run with no changes: https://github.com/fastplotlib/fastplotlib/actions/runs/6741145455/job/18325388102#logs

diff examples:

nb-diff-astronaut_RGB-rgb

nb-diff-astronaut-rgb

nb-diff-lines-cmap-viridis-rgb

nb-diff-lines-underlay-rgb

all diffs: screenshot-diffs (2).zip

Mayb github actions added new hardware recently and jobs that get sent there fail 🤷‍♂️

We should probably implement this anyways pygfx/wgpu-py#400

@almarklein just FYI

@kushalkolar
Copy link
Member Author

this doesn't hasn't happen in the past ~2 months, not sure what was up

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant