Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[resolver] WIP Utility to resolve AQ csv and GPD log trace dailies #13

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

kuanb
Copy link

@kuanb kuanb commented Jun 6, 2018

Intent: Develop a contained ETL process through which the following is achieved:

  • Extraction of daily logs held in directories containing GPS trace and AQ data
  • Exposed cli.py interface to enable command line invocation of ETL process

Open questions:

  • To what extent is timezone necessary? Are both .log and .csv files in UTC GMT? If not, then what?
  • Python scripts should conform to an agreed upon standard- should we have pre-commit checks? What development environment is desired? Should I set up a base Dockerfile from which to run this stuff? Does one already exist?

Why submit PR early?

  • Keep me going / pressure to complete
  • Expose development for comment as it occurs

return select


def load(target_day_dir: str) -> Dict[str, pd.DataFrame]:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh my god function annotations. i am not ready for this

@rsoden
Copy link
Contributor

rsoden commented Jun 15, 2018

This looks awesome. Hope we can discuss soon. Let me know if you can make it on Tuesday, otherwise we can try for a call?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants