Platform: AWS Tools: Spark ,Scala ,Python ,Hadoop,Hive ,MySQL Description: This project is based on Network Data Streaming which involves Data Ingestion ,Data Validation. It is a telecommunication project which involves ingestion of various network data of users using 4G and 5g network.Data is streamed from the Newrelic source to the destination. My role in the project is to implement the logic for counts of different data segregated into 4G and 5G routed from the source to the destination . Worked on Spark-Scala to parse JSONs retrieved from NewRelic App and validating the data. Assisted in implementing modules for total unique count of different streams of messages coming from at the source as well at the destination.Involved inmanual testing of network data . Also assisted in onboarding apps to Hadoop Cluster for Data Ingestion. Daily monitoring of apps to maintain good health and manage failures. I also involved in providing support to the production support team regarding any failure orissues.

Platform: AWS Tools: Spark ,Scala ,Python ,Hadoop,Hive Description: This project is based on Data Streaming which involves Data ingestion from the source. I worked in this project for 3 months. My role in this project is to do the validation of incoming data at the source and to report any issues in it .I also involved in onboarding different apps to platform ,creating and managing data in directories. Effciently deployed and integrated application modules on cloud and updated integration scripts. I also involved in monitoring the health status of the job and to prepare a report based on those observations.