Maintaining call data records and processing it as per the needs from the client for storage

• Worked on more than 70 scenarios for development and enhancement.
• Transformation script writing in Pig
• Worked on several semi-structured formats to process datasets in Pig like JSON, XML , CSV
• Implemented custom UDF in Pig
• Worked on Hadoop and Spark integration from scratch
• Data streaming  using Spark
• Spark SQL to connect with Hive warehouse
• Large datasets processing in Spark DataSet
• Worked on RDDs, Transformations, Actions
• Worked on several functions in Scala Library to build Spark Applications using Spark SQL
• Linear Regression

• Worked in Development,QA,Preprod Environments
• Migration from MYSQL  in Hive using SQOOP
• Daily batch run and bug fixing in real time
• Have worked on critical scenarios and given feasible and efficient solutions
• Product development and release management