About Me
Around 7 years of IT experience in Tableau and Big Data Hadoop and spark. Experience in Hadoop and its components like Spark, Scala, PySpark, HDFS, Pig, Hive, Impala, Sqoop, HBase, Oozie and Airflow. Experience in Tableau as a Developer. Having exper...
Show MoreSkills
Positions
Portfolio Projects
Description
Project Name : mFisH (Multi Fluorescent in situ Hybridization)
Client : GSK.
Environment : PySpark, Hive, PyCharm, shell script, AWS S3, Airflow and Agile (Scrum)
Role : Hadoop and Spark Developer.
Description:
mFish Cell Line Stability Network provides deep learning workflow to confirm the production stability of a cell line. It has basically two parts ML pipeline, performs deep learning on images and create thumbnails and ETL pipeline that copying data & images to RDIP Hive & Object store.
Roles and Responsibilities:
- Creating Shell script for ETL pipeline to connect and import CSV files to Hive tables.
- Creating Hive DBs and tables and querying the required information.
- Created PySpark script using python.
- Storing thumbnails to AWS S3 bucket using AWS CLI.
- Created DAGs using Airflow workflow scheduler.
Description
Project Name : Beacon Image processing tool
Client : GSK.
Environment : PySpark, Hive, PyCharm, Pandas, NumPy, Sqlalchemy, Airflow and Agile (Scrum)
Role : Hadoop and Spark Developer.
Description:
Beacon Imaging tool will enable scientists to reliably process their experiments and save considerable time in the production of monoclonal antibody producing cell lines.
The beacon instrument is a core element of the cell line development process, it uses sophisticated technology to reduce CLD workflows from 13 weeks to 8 weeks.
Roles and Responsibilities:
- Creating python scripts using PyCharm IDE.
- Used different Python libraries like pandas, NumPy, CV2
- Creating Hive DBs and tables and querying the required information.
- Created pipeline script using python.
- Created DAGs using Airflow workflow scheduler.
Description
mFish Cell Line Stability Network provides deep learning workflow to confirm the production stability of a cell line. It has basically two parts ML pipeline, performs deep learning on images and create thumbnails and ETL pipeline that copying data images to RDIP Hive Object store.
Show More Show LessDescription
R-Solve are sales management system, where we find the sales from the leads and leads from the contacts. It is used to monitor sales on leads.
There are different ways a lead can be created. Lead forms can be created by the customers, customer relation managers, showrooms, auto shows etc.
Lead management tool manages the different leads and is mapped to the different lead sources. This tool sends the leads the leads to respective dealers. The dealer can take this lead and further contact the customer to convert into sales.
Show More Show LessDescription
Beacon Imaging tool will enable scientists to reliably process their experiments and save considerable time in the production of monoclonal antibody producing cell lines. The beacon instrument is a core element of the cell line development process, it uses sophisticated technology to reduce CLD workflows from 13 weeks to 8 weeks.
Show More Show LessDescription
R-Solve are sales management system, where we find the sales from the leads and leads from the contacts. It is used to monitor sales on leads. There are different ways a lead can be created. Lead forms can be created by the customers, customer relation managers, showrooms, auto shows etc. Lead management tool manages the different leads and is mapped to the different lead sources. This tool sends the leads the leads to respective dealers. The dealer can take this lead and further contact the customer to convert into sales.
Show More Show Less
+1 646 305 2118
+91 9875 492266
