Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

optionally override hostname used for default remote rundir #42

Open
bernstei opened this issue Feb 25, 2025 · 6 comments · May be fixed by #43
Open

optionally override hostname used for default remote rundir #42

bernstei opened this issue Feb 25, 2025 · 6 comments · May be fixed by #43

Comments

@bernstei
Copy link
Contributor

bernstei commented Feb 25, 2025

When jobs are being submitted from machines with different names, e.g. multiple login nodes of an hpc, having the submitting hostname be part of the remote rundir is bad, because it means that rerunning the script between job submission and result gathering fails if those two steps are done from different hostnames.

Possible fixes

  1. remote hostname from remote rundir entirely
  2. make a config option to remove hostname part of remote rundir
  3. make a config option to set the effective hostname
@bernstei
Copy link
Contributor Author

@ThomasWarford do you have an opinion?

@bernstei
Copy link
Contributor Author

I'm leaning toward 3, perhaps a field called "remote_rundir_submit_hostname" in the top level of the config.json file, outside of "systems", which will override environ["HOSTNAME"] in the remote rundir name if provided.

@ThomasWarford
Copy link

I think option 3 sounds best too

@bernstei
Copy link
Contributor Author

Do you want to test out the branch in #43 before I merge?

@bernstei bernstei changed the title optionally remove hostname from default remote rundir optionally override hostname used for default remote rundir Feb 25, 2025
@ThomasWarford
Copy link

Sure, thanks for the quick response. It might be a few days before I test though because I have many jobs to run and want to get them finished before changing anything

@ThomasWarford
Copy link

I submitted 8 calculations on one node and gathered them on another. Seems good to me!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants