Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update get_number_of_deaths to match changed FHI schema #13

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

minrk
Copy link

@minrk minrk commented Apr 29, 2021

  • includes use trees api to fetch github data #12 , needed to get full datafiles list
  • fhi no longer includes 'total' rows as of 2021-03-09, so drop totals when present and compute sums ourselves
  • fhi now publishes a 'latest' file, which should be ignored, but raised an error before
  • tweak how rows are appended (use date as index, only sort on save)

contents api truncates to 1000 files, which means test data hasn't been updated since October

trees api is more tedious, but not truncated
- fhi data files no longer include sums, so compute sums instead (dropping sums if found)
- use date as index in dataframe
@minrk
Copy link
Author

minrk commented Apr 29, 2021

Results can be seen in this commit

@minrk minrk mentioned this pull request Jan 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant