About Me

Data Engineer with 2+ years of experience in building data intensive application, tackling complex architecture and scalablity problems. Developing data models and creating ingestion pipleine for leading retail market. Currently engaged with Walmart ...ta models and creating ingestion pipleine for leading retail market. Currently engaged with Walmart relationship to ingest international market data to data lake. Analyzed existing pipeline for Teradata tables. Build Teradata equivalent query for BigQuery mainframe jobs and testing it on google cloud console. Developed connection components, making of copybooks, preparing JCLs and Command Scripts. Build and optimized SQL for Validating data between existing table and migrated table. Converted around 74K existing jobs as per SLAs and got business signoff for the converted jobs by providing the data validation document. Working with business owners to define key business requirements and convert to technical specifications Building application for ingestion from different sources to data lake Building and Developing Data models for the large datasets that consists customer transaction history Generating reports of the tables already ingested for the consumption team and management . Building Automic DAG for scheduling ingestion pipeline and providing L3 support to the production failure. Creating technical documentation for all new or modified processes