Skip to content

Latest commit

 

History

History
 
 

bigquery-snowflake-tables-migration-utility

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 

The Snowflake DDL Migration Utility does the following functionalities:

The script connects to Snowflake Database through the snowflake-python connector The script uses the get_ddl command to retrieve the table schema information The script produces the "create table" statement using the schema information and store the extracted ddl in the specified gcs path The script calls the BigQuery Migration API and converts the ddl to the BigQuery DDL and placed it in the specified gcs path The script create the Bigquery Tables in the specified target dataset The table structure will include source columns, metadata columns and paritioning and clustering info The script archives the DDL files created by the scripts (snowflake_ddl_extraction.py, snowflake_bq_converter.py and archive_ddl.py) The status of each table conversion is logged in the audit table in the target datset The order of execution of the script is as follows

snowflake_ddl_extraction.py snowflake_bq_converter.py bq_table_creator.py archive_ddl.py