About Me
Very good skilled in spark,scala , Hive,Hadoop , Cassandra, mysql ,java and Kafka
... Show MoreSkills
Web Development
Database
Data & Analytics
Software Engineering
Others
Mobile Apps
Development Tools
Programming Language
Operating System
Portfolio Projects
Company
Built a big Data pipeline batch + stream for a leading retail company
Description
Created a big data pipeline using Kafka for a stream pipeline
And a batch pipeline using spark and sqoop and using big query as database
All of above was done on Google cloud platform
Show More Show LessTools
Apache Hive Google Cloud KafkaCompany
Clix
Description
Understand the requirement and creating a pipeline for ETL based on client use case. Working on a framework for bulk ingestion which also handled multiple scenarios like PII tables handling ,ingestion of tables with or without specific column etc. Automation of the whole process of ingestion and validation of data according to client requirment. Worked on data transformation and data handling of ingested data into the raw layer.
Show More Show LessTools
ETL