Skills
Web Development
Data & Analytics
Programming Language
Database
Others
Positions
Portfolio Projects
Company
Data modernization
Role
Data Scientist
Description
Delivered an efficient,smooth pipeline to migrate data from sql server to snowflake using data lake as azure blob storage with the help of azure data factory and developed a alert system to state if the pipeline fails over platforms like email and Microsoft teams using logic apps.
Show More Show LessSkills
Azure Blob SQL Azure DataFactory AzureCompany
Pinnellas
Description
Here i had a minor role to tranfer the data from cli instance to snowflake. The challenge over here the team was facing was to uploading the data with more than 6 million records to snowflake using kafka . Here i wrote a script in python to upload the data directly to snowflake in the cli instance
Show More Show Less