Yogesh K.

Yogesh K.

Expert Hadoop and Spark developer with 6 years of experience.

Delhi , India

Experience: 6 Years

Yogesh

Delhi , India

Expert Hadoop and Spark developer with 6 years of experience.

6 Years

Now you can Instantly Chat with Yogesh!

About Me

· 4 years and 8 months of experience in Big Data Hadoop and spark.

· 1 year and 4 months of experience in Informatica Powercenter and AS400.

· Working as a technical lead at offshore and responsible for end to end delivery..

...

Show More

Portfolio Projects

Nuance

Parsing of Unstructured data (Nuance IVR call detail logs) to Structured data

Company

Nuance

Role

Full-Stack Developer

Contribute

Involved in analysis and functional discussion with the clients. Developed python scripts to parse unstructured data to structured. Created shell scripts to handle process flow. Created PySpark job.

Description

I was responsible for the delivery of this complete project.

Involed in customer discussion about requirements and architecture.

Responsible to develop complete process flow using shell scripts.

Responsible to develop python script to parse unstructured call details into structured format and load that into hive table.

Responsible to create PySpark job and monitoring of it.

Show More Show Less

Humana At Home

Implement data science logic into spark sql and generate triggers.

Company

Humana At Home

Role

Full-Stack Developer

Contribute

Involved in analysis and functional discussion with the clients. Created shell scripts for complete process flow. Developed PySpark code as per data science logic. Created Pyspark job and moniored it

Description

Involved in analysis and functional discussion with the clients.

worked with data science team to get required logic to gether all the required data.

Developed Spark SQL code to implement data science logic to generate triggers which defines the ups and downs in various healthcare domains.

Created shell scirpts to implement complete process flow.

Create PySpark job and monitored it. 

Show More Show Less

Data Migration

Data Migration from RDBMS sources to Hadoop

Company

Data Migration

Role

Full-Stack Developer

Contribute

Involved in analysis and functional discussion with the clients. Developed Sqoop and hive scripts to import data from RDBMS. Developed workflows to run jobs.

Description

Involved in analysis and functional discussion with the clients.

Developed sqoop commands for different RDBMS sources to import data on HDFS.

Developed Custome hive scripts to transform the data that is suitable to store in hive tables and then load the data to hive and hbase.

Developed python script to generate Oozie workflow xml to handle the complete process flow automatically.

Developed shell scripts to support sqoop and hive commands.

 

Show More Show Less