Worked as a Data Engineer to handle huge volume of data and performed data integration, ETL and data encoding. Worked along with line of Business and data scientists for requirment gathering and delivered quality and featured data to data scientists to apply mahine learning algorith to build a model.

As a POC, build the system to predict whether the medical device will failure or not. Used FDA data for selected devices and trained he model.

Domain: Financial Service Hadoop Ecosystem: HDFS, Hive, Impala, Pyspark Hadoop Distribution: Cloudera Language: Java and Python Responsibilities: Collect and understand the requirements from client. Developed Pyspark, Hive and Impala code to achieve clients requirement. Created UDFs for complex functions. Applied tuning and optimization technique for quick and better results. Worked alongside with Data Science team for Feature Engineering.

Domain: Life Science Hadoop Ecosystem: HDFS, Hive, Sqoop. Language: Java Hadoop Distribution: Cloudera Responsibilities: Monitored and restarted Hadoop services. Data Ingestion to HDFS using Sqoop. Performed data analytics as per clients requirement. Created UDF in Java for Hive.

Hadoop Ecosystem: HDFS, Hive, Flume. Language: R programming. Responsibilities: Hosted Hadoop cluster. Gathered Streaming of tweets from Twitter using Flume. Performed data preprocessing using Hive. Applied Anonymization algorithm using R language. Generated report using R language.