Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snow depth variable name - missing from constants #109

Open
zakwatts opened this issue Jan 2, 2025 · 3 comments
Open

Snow depth variable name - missing from constants #109

zakwatts opened this issue Jan 2, 2025 · 3 comments

Comments

@zakwatts
Copy link
Contributor

zakwatts commented Jan 2, 2025

When training PVNet, the snow depth variable is specified in the config. But PVNet fails to train. This is due to the snow depth variable name sd not being in the constants.py file.

For the old ECMWF and Met Office datasets (no extending past 48 hours) the snow depth variable we pulled was called sde.

From the new extended NWP datasets, ECMWF snow depth variable is sd and Met Offices is sde.

Need to research the difference between sd and sde.

Will require a new constant to be added to the constants.py file to be able to train with snow depth.

@zakwatts
Copy link
Contributor Author

zakwatts commented Jan 2, 2025

From a previous issues, appears we receive sd in live from the met office. (as apposed to sde in the backtest)

From @devsjc comment

sd is from the met office live data, it's the Snow Depth Water Equivalent in and it's measured in kgm-2
sde is from ceda, also snow depth water equivalent, but this one is measured in m

They differ by a factor of ~1000

openclimatefix/MetOfficeDataHub#71

@zakwatts
Copy link
Contributor Author

zakwatts commented Jan 2, 2025

In production both ECMWF and Met Office are sde. Based off internal dashboard for ECMWF and Met Office.

Screenshot 2025-01-02 at 16 33 05

@zakwatts
Copy link
Contributor Author

zakwatts commented Jan 2, 2025

Screenshot 2025-01-02 at 16 39 14

sde in the old ECMWF and sd in the new extended ECMWF appear to be the same.

Also worth noting that the extended ECMWF has half the spatial resolution of the old ECMWF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant