Yogesh K.

Expert Hadoop and Spark developer with 6 years of experience.

Delhi , India

Experience: 6 Years

Yogesh

Delhi , India

Expert Hadoop and Spark developer with 6 years of experience.

USD / Year

Start Date / Notice Period end date:

6 Years

Now you can Instantly Chat with Yogesh!

Chat Now

About Me

· 4 years and 8 months of experience in Big Data Hadoop and spark.

· 1 year and 4 months of experience in Informatica Powercenter and AS400.

· Working as a technical lead at offshore and responsible for end to end delivery..

...

Skills

Positions

ML/AI Engineers

Software Engineer

Data Engineer

Portfolio Projects

Implement data science logic into spark sql and generate triggers.

Contribute

Involved in analysis and functional discussion with the clients. Created shell scripts for complete process flow. Developed PySpark code as per data science logic. Created Pyspark job and moniored it

Description

Involved in analysis and functional discussion with the clients.

worked with data science team to get required logic to gether all the required data.

Developed Spark SQL code to implement data science logic to generate triggers which defines the ups and downs in various healthcare domains.

Created shell scirpts to implement complete process flow.

Create PySpark job and monitored it.

Show More Show Less

Parsing of Unstructured data (Nuance IVR call detail logs) to Structured data

Contribute

Involved in analysis and functional discussion with the clients. Developed python scripts to parse unstructured data to structured. Created shell scripts to handle process flow. Created PySpark job.

Description

I was responsible for the delivery of this complete project.

Involed in customer discussion about requirements and architecture.

Responsible to develop complete process flow using shell scripts.

Responsible to develop python script to parse unstructured call details into structured format and load that into hive table.

Responsible to create PySpark job and monitoring of it.

Show More Show Less

Data Migration from RDBMS sources to Hadoop

Contribute

Involved in analysis and functional discussion with the clients. Developed Sqoop and hive scripts to import data from RDBMS. Developed workflows to run jobs.

Description

Involved in analysis and functional discussion with the clients.

Developed sqoop commands for different RDBMS sources to import data on HDFS.

Developed Custome hive scripts to transform the data that is suitable to store in hive tables and then load the data to hive and hbase.

Developed python script to generate Oozie workflow xml to handle the complete process flow automatically.

Developed shell scripts to support sqoop and hive commands.

Show More Show Less