Developed Spark-Streaming Job to Consume Messages from Kafka for all Layers in pipeline for High Frequency File processing. Developed Spark job to process the files. Developed the Job using Oxygen Framework(Customized framework of Experian for processing files). Handling Problem Reports, daily tracking of jira production issues and First Level Analysis of tickets.

● Responsible for Designing the architecture of Data processing Pipelines.
● Leading the team of Development.
● Worked on Aws Lambda , Aws Step function , Aws Event and Aws S3 .
● Worked on Terraform(Infrastructure as a code).
● Developed python script to process gigabytes of files.
● Responsible for Requirement gathering from client.
● Handling Problem Reports, daily tracking of production issues and First Level Analysis of tickets

● Developed CNN model to detect water level from satellite images of landmarks and stored it in Local Datacenter .
● Worked on Local Data Center at Deloitte to build and improve the performance of the Model.
● Researched and read technical papers to improve the performance of the model.
● Developed the CNN Models using python , tensorflow , scipy and matplotlib .
● Closely working with CTO and Other Master’s of Machine Learning .
● Member of Master’s of Machine Learning Guild(Internal group for Machine Learning Master’s and Research)

● Worked on Apache Kafka , Spark , HDFS and AWS for Log Processing and Storing.
● Worked on Aws (Amazon Web Service) cloud.
● Responsible for designing the architecture of Log processing Pipelines.
● Developed Python script to download the files from AWS s3 and push it to Kafka Topic .
● Developed Spark-Streaming job in scala for consuming messages from Kafka and writing it to HDFS .
● Developed Recommendation System of Samsung Smart Tv based on shows visits using Python, scipy, numpy ad scikit-Learn .
● Developed online Recommendation System for Smart TV using Spark-MLlib and pyspark .
● Created High Level Design documents.
● Participated in AWS Iot (Internet of things) Hackathon and proposed idea was selected as a winner.
● Handling Problem Reports, daily tracking of production issues and First Level Analysis of tickets.

● Developed Map Reduce job using java to process the files and storing it in HDFS .
● Worked on bugs and change request in existing batch job i.e Map Reduce job.
● Involved in Bug Fixing and Change Request .
● written unit test cases for the developed code using JUNIT and Mockito