Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using the repro test to check experiment configuration #102

Open
anton-seaice opened this issue Feb 17, 2025 · 0 comments
Open

Using the repro test to check experiment configuration #102

anton-seaice opened this issue Feb 17, 2025 · 0 comments

Comments

@anton-seaice
Copy link
Contributor

anton-seaice commented Feb 17, 2025

There are certain stylistic/neatness choices we could enforce through CI which runs the model (a.k.a. the repro test).

One is confirming that the contents of the manifests committed to the repository are correct.

The second is specific to ACCESS OM3, which is that the contents of the docs folder match the MOM_parameter_docs.* output produced by MOM. (These are a complete record of the runtime configuration parameters used). After payu-org/payu#565 is implemented, payu will be doing this step.

When used in a Pull-request, the historical reproducibility test compares the results to the saved checksums in the target branch. These new tests would be confirming that the target branch includes the correct (automatically generated) updates to manifests and documentation, so would compared to the source branch.

Arguably, current payu behaviour covers this well enough. In that manifests and MOM_parameter_docs are committed if runlog is enabled. However this doesn't guarantee consistency when a change is made to a config, (as runlog entries are not desired in a release configuration which starts from some initial condition).

@anton-seaice anton-seaice changed the title Using the repro test to check the experiment configuration Using the repro test to check experiment configuration Feb 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant