About Me
Data Engineer with 2+ years of experience in building data intensive application, tackling complex architecture and scalability problems. Developing data models and creating ingestion pipeline for leading retail market. Currently engaged with Walm...
Show MoreSkills
Software Engineering
Development Tools
Web Development
Programming Language
Database
Others
Software Testing
Positions
Portfolio Projects
Company
Walmart DSI Modernization
Role
Data Engineer
Description
- Analyzed existing pipeline for Teradata tables.
- Build Teradata equivalent query for BigQuery mainframe jobs and testing it on google cloud console.
- Developed connection components, making of copybooks, preparing JCLs and Command Scripts.
- Build and optimized SQL for Validating data between existing table and migrated table.
- Converted around 74K existing jobs as per SLAs and got business signoff for the converted jobs by providing the data validation document.
Company
Walmart INTL D&A Foundation
Description
- Working with business owners to define key business requirements and convert to technical specifications
- Building application for ingestion from different sources to data lake
- Building and Developing Data models for the large datasets that consists customer transaction history
- Generating reports of the tables already ingested for the consumption team and management .
- Building Automic DAG for scheduling ingestion pipeline and providing L3 support to the production failure.
- Creating technical documentation for all new or modified processes