How to migrate from Teradata to Snowflake?
Hi all, We have one requirement where we have to migrate the existing Teradata to Snowflake, below is the full requirement
•Conversion of SAS jobs and Unix shell scripts to python along with conversion of all Teradata SQL to Snowflake SQL. Leverage Python and PySparkto contain functionality of Teradata BTEQ as much as possible
•Conversion of all Teradata views to Snowflake compatible views
•Conversion of Teradata Stored Procedures to SnowSQL/ Snowflake SP
•Convert all Teradata tables to Snowflake Tables. Assuming 300 tables and 1000 secondary indexes.
•Setup Snowflake environment with all DDL and security structures, ready for end user usage.
I am thinking to this way:
step1: Migrate the Metadata from Teradata to Snowflake
step2: Migrate the data using Spark with Python
Need your help :
In step1 is there any way where we can convert DDL(Metadata) to snowflake easily
In step2 we have 2 type of loading(History,Incremental)
I believe Incremental load can be handled using Python/SPARK, how to load huge History loading.
Please let me know if am aligned with my requirement, if not help me with the suitable approach.
I will be grateful for any help you can provide.
moyeenbasha
posted on 05 Mar 20Enjoy great content like this and a lot more !
Signup for a free account to write a post / comment / upvote posts. Its simple and takes less than 5 seconds
Post Comment