v0.1.0
The first release of VirtualiZarr!
This release presents the basic MVP of this library, including the ability to inspect netCDF4/HDF5 files, store the byte ranges in an xarray.Dataset
via ManifestArray
objects, concatenate those objects, then serialize the result to disk as kerchunk-formatted reference files.
Expect more features and significant optimizations soon.
What's Changed
- Xarray accessor to create kerchunk reference dict by @TomNicholas in #28
- Equality checking by @TomNicholas in #30
- Support xarray concat, including broadcasting by @TomNicholas in #34
- CI for running tests by @TomNicholas in #36
- Roughout of Sphinx Docs by @norlandrhagen in #27
- Updated doc.yml to include pip by @norlandrhagen in #40
- Adds netCDF3 vs netCDF4 distinction to _automatically_determine_filetype. by @norlandrhagen in #43
- Test concat of dimension coordinate not backed by an index by @TomNicholas in #44
- Rename open_dataset_via_kerchunk to open_virtual_dataset by @TomNicholas in #47
- Narrative docs by @TomNicholas in #48
- More narrative docs by @TomNicholas in #50
- Update CI checks with ruff by @norlandrhagen in #54
- open_virtual_dataset with and without indexes by @TomNicholas in #52
- API docs by @TomNicholas in #56
- Updated NetCDF IO path by @norlandrhagen in #55
- Created conftest.py and moved two fixtures into conftest by @norlandrhagen in #57
- Ab/filters dtype by @abarciauskas-bgse in #66
- Switching netcdf3 & netcdf4 filetype detection to file magic 🧙 by @norlandrhagen in #64
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #70
- Load selected variables instead of making them virtual by @TomNicholas in #69
- pin_kerchunk_0.2.2 by @norlandrhagen in #75
- Remove python 3.12 from CI matrix by @TomNicholas in #76
- Convert user defined filetype to FileType by @norlandrhagen in #79
- FAQ page by @TomNicholas in #81
- Try to remove sidebar in docs by @TomNicholas in #82
main.yml
CI installs from pyproject.toml by @norlandrhagen in #90- Update installation instructions by @jbusecke in #91
- Write manifests to zarr store by @TomNicholas in #45
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #101
- Bump Ruff version and add formatting by @jbusecke in #98
- Opening 0D scalars by @TomNicholas in #102
- Fix bug with expand dims of a scalar array by @TomNicholas in #103
- Install xarray from main by @jsignell in #106
- Unpin kerchunk (set floor) and enable Python 3.12 by @jsignell in #108
- Depend on latest version of xarray by @TomNicholas in #109
- Remove python 3.9 by @jsignell in #112
- Adding
reader_options
kwargs to open_virtual_dataset. by @norlandrhagen in #67 - Write to parquet by @jsignell in #110
- Test fsspec roundtrip by @TomNicholas in #42
- Inline loaded variables into kerchunk references by @TomNicholas in #73
- Release notes page by @TomNicholas in #120
- requires-python = ">=3.10" by @abarciauskas-bgse in #127
- Pass args and add test by @abarciauskas-bgse in #128
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #129
- Allow other fsspec protocols than local and s3 by @TomAugspurger in #126
- Add dunder version to top-level init.py by @maxrjones in #133
- Add release workflow by @maxrjones in #136
- Only run distribution workflow on releases by @maxrjones in #140
- change default reader_options to None by @TomNicholas in #137
- Replace np.NaN with np.nan in preparation for numpy 2.0 by @TomNicholas in #138
New Contributors
- @TomNicholas made their first contribution in #28
- @abarciauskas-bgse made their first contribution in #66
- @pre-commit-ci made their first contribution in #70
- @jbusecke made their first contribution in #91
- @jsignell made their first contribution in #106
- @TomAugspurger made their first contribution in #126
- @maxrjones made their first contribution in #133
Full Changelog: https://github.com/zarr-developers/VirtualiZarr/commits/v0.1