Releases: TobikoData/sqlmesh
Releases · TobikoData/sqlmesh
v0.10.0
🪲 Bug fixes
- Fix State Sync CTAS Replace (#861) @eakmanrq
- Hydrate the seed model if needed in the built-in scheduler (#859) @izeigerman
- Make sure that seed column hashes are updated during the migration (#863) @izeigerman
- Duplicates on migrations (#862) @tobymao
v0.9.0
✨ Features
- Allow sqlmesh models to import jinja macros. (#837) @tobymao
- Cache snapshot start to improve load time of large projects (#826) @crericha
- Introduce state backups during migrations (#824) @vchan
- Feat[breaking]: don't qualify columns on external tables. (#840) @tobymao
- Store seed content separately from snapshot payload (#853) @izeigerman
- Display external table in lineage (#857) @mykalmax
🪲 Bug fixes
- Support manifest generated by dbt 1.2 (#839) @izeigerman
- Run only one workflow at a time in CircleCI @izeigerman
- Use load API to insert append dataframes in the BigQuery adapter (#841) @izeigerman
- Use pd.DataFrame to insert snapshots and environments in state sync (#843) @izeigerman
- Use the public SQLGlot diff API when categorizing changes (#845) @izeigerman
- In Engine Adapter automatically infer columns-to-types from a DataFrame (#844) @izeigerman
- Remaining Engine Adapter API which require column schema when pandas DataFrame is passed (#847) @izeigerman
- Use explicit column-to-types mapping in the state sync @izeigerman
- Python 3.7 mypy @izeigerman
- Use Snowflake's API to write a dataframe into a table (#850) @izeigerman
- Escape JSON when inserting a dataframe (#849) @izeigerman
- Mypy error due to merging without rebasing first @izeigerman
- Return no missing intervals for seed models if evaluated at least once (#851) @izeigerman
- Improve lineage performance (#848) @mykalmax
- Simplify validation @izeigerman
- Improve performance of sushi example. @tobymao
- In Snowflake adapter return the DataFrame as is without modifying its column names. (#846) @izeigerman
- Move circleci release pipeline back into the config.yaml @izeigerman
🛠️ Refactor
- Use sqlglot's exp.insert to simplify Insert building (#855) @georgesittas
🧹 Chore
- BREAKING remove unused getter apis for macros/hooks (#838) @tobymao
- Move the release workflow into the continue_config.yml @izeigerman
- Fix CircleCI config @izeigerman
- Improve error message @tobymao
👽 Other
v0.8.1
✨ Features
🪲 Bug fixes
- Include source dependencies in depends_on for dbt models. (#827) @crericha
- Fix json encoding for models (#828) @vchan
- Pin dbt-duckdb version to avoid test failures @izeigerman
- Replace exp.StructKwarg with exp.ColumnDef in schema diff (#830) @georgesittas
- Improve the change categorization results by pre-matching root AST nodes (#831) @izeigerman
- Various bugs from file tree, editor, lineage, docs (#832) @mykalmax
- Improve performance of get snapshots queries by using IN instead of AND/OR (#820) @crericha
👽 Other
v0.8.0
✨ Features
- Add loading logging to dbt adapter (#804) @crericha
- Gateway configuration BREAKING CHANGE (#807) @izeigerman
- Extend Airflow integration with the ability to provide an external DB connection for SQLMesh state (#811) @izeigerman
- Introduce logical merge for adapters that do not natively support merge (#802) @crericha
- BREAKING always parse macro returns as sql (#815) @tobymao
- Add Github Actions CI/CD Bot (#810) @eakmanrq
- Set up Docs (#801) @mykalmax
- Log exception stack traces from executor tasks to API console (#825) @vchan
- Use dbt manifest to load dbt projects (#821) @izeigerman
🪲 Bug fixes
- In Postgres engine adapter only commit if there's no active transaction (#800) @izeigerman
- Pin ruamel.yaml version when running airflow tests on CircleCI @izeigerman
- Data leakage was incorrect with window functions BREAKING CHANGE (#805) @tobymao
- Enforce unpaused parent snapshots only for new snapshots (#809) @izeigerman
- Don't add where false if no from statement @tobymao
- Use package materialization config in dbt fixture (#816) @crericha
- Cnclude missing direct model names (#822) @mykalmax
🧹 Chore
👽 Other
- Update uvicorn development server configs (#806) @vchan
- Continue watching even if context.load() fails, e.g. typos in a model file (#808) @vchan
- Format code (#812) @cornzyblack
- Update engines.md (#813) @wseaton
- Remove unneeded expand @tobymao
- Improve BigQuery Pandas Implementation (#814) @eakmanrq
- Add missing import (#823) @eakmanrq
v0.7.0
✨ Features
- Introduce LLM integration (#799) @izeigerman
🪲 Bug fixes
- Make start_date an actual date and add start_dt @tobymao
v0.6.4
🪲 Bug fixes
- Remove overlapping intervals in old snapshots superseded by a new unpaused snapshot with the effective date set (#788) @izeigerman
- Normalize macro names @tobymao
- Merge should use columns_to_types, so it can support pandas dfs (#792) @crericha
- DataFrame Where Clause Quoting (#793) @eakmanrq
🛠️ Refactor
- Print rendered dag location in terminal (#789) @cornzyblack
🧹 Chore
- Add redshift profile to dbt example project (#791) @crericha
- Bump sqlglot to v11.6.3 (#795) @georgesittas
👽 Other
v0.6.3
✨ Features
- Add ability to set the effective date for forward-only snapshots (#785) @izeigerman
🪲 Bug fixes
- For forward-only plans run backfill after promotion (#774) @izeigerman
- Display nodes more condensed, update connection on column name change (#781) @mykalmax
- Support dbt model jinja method, use dialect when parsing, catch duplicate key errors, and improve parse time for very large sql models (#782) @crericha
- When applying a forward-only plan in dev the backfill shoulde precede the promotion (#786) @izeigerman
- Handle no rows in versions table due to corruption @tobymao
- Flaky test with new sqlglot. @tobymao
🧹 Chore
- Upgrade to sqlglot 11.6 and clean up example project paths @tobymao
👽 Other
- Reset selected lineage columns on tab change (#772) @mykalmax
- Add Dataframe Merge Support (#770) @eakmanrq
- Remove self from depends_on (#773) @eakmanrq
- Use jinja2 loopcontrols extension (#776) @crericha
- Remove catalog/db from spark temp view (#777) @eakmanrq
- What does backfill mean? (#778) @foundinblank
- Modify quickstart project and add seed file (#779) @foundinblank
- Add model tags field (#775) @vchan
- Redshift config port can be a string in profiles.yml (#784) @crericha
v0.6.2
🪲 Bug fixes
- Caching of rendered dbt model configs by making the dependencies attribute public (#768) @izeigerman
- Don't validate on migration (#771) @tobymao
v0.6.1
v0.6.0
✨ Features
- Display tests report (#729) @mykalmax
- [dbt] Support incremental_by_unique_key when unique_key defined with no incremental_strategy (#731) @crericha
- Add execution config for BigQuery (#732) @eakmanrq
- Introduce the caching layer when loading SQL models (#733) @izeigerman
- Column-level lineage (#663) @mykalmax
- Lookback windows closes #728 (#736) @tobymao
- Add dialect to cli render closes #741 @tobymao
- Add lookback to dbt projects (#760) @crericha
- Highlight know columns in editor (#761) @mykalmax
🪲 Bug fixes
- Fix links (#739) @crericha
- Clarify in docs that type casting in a model's query is not mandatory (#742) @izeigerman
- Drop view in order to replace it when using Postgres (#751) @izeigerman
- Explicitly set the end and the latest dates in the Airflow end-to-end test @izeigerman
- Enable logging in CLI when the debug mode is enabled @izeigerman
- Clean-up target defaults (#735) @crericha
- Dbt hook yaml formats, duplicate yaml keys, and sources without tables (#745) @crericha
- Apply lookback window to the data interval start date when running a cadence DAG in Airflow (#759) @izeigerman
- Allow empty files in models folder and refetch lineage on model file change (#746) @mykalmax
- Selecting column in lineage (#766) @mykalmax
- Migrate table schemas only for snapshots with the FORWARD_ONLY category explicitly assigned (#763) @izeigerman
- Introduce environment finalization (#764) @izeigerman
- Airflow integration test by assigning a change category correctly @izeigerman
🧹 Chore
- Add ability to enable a debug mode (#743) @izeigerman
- Add the 'info' command to CLI (#744) @izeigerman
- Move batch_size inside kind. BREAKING CHANGE. (#749) @tobymao
- Update vm2 version (#747) @mykalmax
- Delete project cache before using in a test (#762) @crericha
👽 Other
- Updated notebook.md (#734) @ShanksData
- Fixed typo (#738) @AlessandroLollo
- Add bigquery storage dependency (#756) @eakmanrq
- Add Postgres to engine configuration list (#755) @jared-rimmer
- Remove pg keep_alives default (#758) @eakmanrq
- Update tests @tobymao
- Update slack links @tobymao
- Update slack link (#767) @vchan