Skip to content

Latest commit

 

History

History
90 lines (52 loc) · 5.25 KB

toolbox.md

File metadata and controls

90 lines (52 loc) · 5.25 KB
layout title
default
Toolbox

BiG CZ Data Toolbox

The BiG CZ Data Toolbox is a single, easy-to-install, easy-to-teach cross-platform package of the ODM2 software ecosystem and power functions for accessing BiG CZ Data Catalog and Web services.

It will serve cyber-savvy CZ scientists with powerful tools for local data management and publication and for access, analysis and modeling of data available via the BiG CZ Data Portal and other data repositories.

The BiG CZ Data Toolbox is an easy-to-install software system that includes graphical user interface (GUI) applications within an independent Python environment built upon the Conda packaging system and Conda virtual environments.

This collection of software was showcased at our capstone 2017 BiG-CZ / ODM2 Hands-On Workshop. The complete content of the workshop, including slides, walk-through examples and installation packages, is available at https://github.com/BiG-CZ/bigcz_wshp2017.

BiG CZ Data Toolbox Components

ODM2 Conda Channel

The ODM2 Conda Channel provides easy-to-install options for installing our ODM2 Python libraries or a customized environment for the Anaconda or Miniconda scientific Python distribution.

BiG CZ Jupyter Notebooks

These Jupyter Notebooks in Python and R demonstrate and teach BiG CZ & ODM2 software and database use, and were used as training materials for the capstone 2017 BiG-CZ / ODM2 Hands-On Workshop:

For a complete set of hands-on materials from the workshop, including all notebook files, supporting code, data files, and Conda environment files, git clone the following repository:

ODM2 Database

A ready-to-use relational database based on ODM2 implemented in SQLite, Microsoft SQL Server, MySQL or PostgreSQL (https://github.com/ODM2/ODM2) and pre-populated with ODM2 Controlled Vocabularies (http://vocabulary.odm2.org).

Extensive ODM2 documentation and scripts for creating ODM2 relational databases are available now.

ODM2 Python Application Programing Interface (API)

A set of Python functions that provides data read/write access to an ODM2 database by leveraging SQLAlchemy. It is cross-platform compatible and supports many of the additional software components of the ODM2 & BiG CZ software systems. It can be used directly from a Jupyter notebook or other Python script, or to build complex desktop or web applications.

ODM2 Web Services

Web services for sharing data from an ODM2 database using:

ODM2 Dataset Ingest via YODA-Tools

The YODA Tools library, which is built upon the ODM2PythonAPI, was developed to ingest datasets from our YODA Excel Templates and load these datasets into ODM2. YODA Tools has a simple desktop application, in addition to providing all functions in Python.

Read more at https://github.com/BiG-CZ/bigcz_wshp2017/blob/master/Topics/5-ODM2DatasetsYODAspreadsheets.md.

ODM Tools Python

ODM Tools time series exploration. A GUI desktop application for visualization and scripted quality control of environmental sensor observations data. Fully functional with ODM 1.1. ODM2 support has been added and is currently being tested. https://github.com/ODM2/ODMToolsPython.