Now you can Instantly Chat with Rajesh!
About Me
Software professional with over 12 years of IT experience in diversified fields Hadoop, Spark and Mainframe Development. 2+ years of extensive experience in Bigdata and Big Data Analytics, Hadoop, HDFS, data ingestion pipeline design and advance data...nce in Bigdata and Big Data Analytics, Hadoop, HDFS, data ingestion pipeline design and advance data processing using Spark Framework. In depth understanding of Hadoop Architecture and various components such as Name node, Data node, Resource manager, Application master, Node manager, job tracker, Task tracker etc. Highly capable for processing large sets of Structure, semi - structure and unstructured dataset and supporting BigData applications. Hands on experience with Hadoop Ecosystem components like MapReduce (Processing), HDFS (Storage), YARN, Syncsort, Hive, Spark, Kafka for data storage and analysis. Experience in transferring data between a Hadoop ecosystem and structure data storage in a RDBMS such as MY SQL and DB2 using sqoop. Experience in NoSQL databases like HBase. Extracted the data from RDBMS into HDFS using sqoop. Dataset transferred from Mainframe to HDFS using Syncsort. Migration from different databases (i.e DB2) to Hadoop. Developed Hive scripts for end user / analytic requirement to perform ad hoc analysis. Very good understanding of Partitions, Bucketing concept in Hive and designed both managed and external table in Hive to optimize performance. Proficient in end-to-end development of software products from requirement analysis to system study, designing, testing, de-bugging, documentation and implementation. 10+ Years of strong hands on experience in Mainframe as developer in Development/Maintenance and production support projects. Worked extensively in Mainframe - COBOL, JCL, DB2, Quikjob, IBM Utilities (IDCAMS, IEBGENER, SYNCSORT) and VSAM. Strong analytical, problem solving & organizational abilities Conducting System Analysis / Process Study for project scoping and tracking. Implementing project plans within deadlines. Defining best practices for project support and documentation. Understanding the technical & functional specifications. Design, development, testing, troubleshooting and debugging of the application. Provide post-implementation, enhancement and maintenance support to client for application. Resolving all the concerned issues upon getting approval from concerned authorities. Extending high-end technical support on Mainframe server and ensuring high customer satisfaction levels through prompt redressal of their problems. Have total responsibility for the creation, migration, and ownership of the schedules, JCL and PROCs and other batch resources. Perform project management of estimating, scheduling, and monitoring tasks. Ability to follow recovery procedures to restart a batch workload that was interrupted by a system failure. Provided support for the daily batch production cycle which included JCL changes, restart and recovery procedures and notification of the appropriate application programmer to resolve batch abends. Preparing Abend Logs and Checkpoints, Monitoring Test cycles.
Show MorePortfolio Projects
Description
Worked as Hadoop Developer on a project which migrates the data from Mainframe to Big Data platform. Worked on creating/maintaining a Pyspark program for both batch and real time updates/retrieval of the data from online portal to Hbase and Hive. Create Hive queries to retrieve the other application data from central repository and in corporate them into Batch process and performing application logic to come up with derived values based on rules. Used Oozie to schedule the batch workflows and worked on enabling multiple batch executions of same workflow on same day by making sure there is no conflict between the execution. This help in sending near to real-time data to the downstream applications. Worked on solving the data quality issues identified by the business owners. Reviewed the production execution of the process and optimizing the workflows by enabling parallel process for independent section and tuning the hive queries. Created daily and weekly email alert processes with the statistics of certain data from application. Created pyspark program to archive/delete the inactive data form Hbase and Hive Tables. Collaborated with developers and performance engineers to enhance supportability and identify performance bottlenecks. Followed Agile process for the project as a team member by working on the user stores/tasks assigned and updating the efforts and providing status regularly.
Show More Show LessVerifications
-
Phone Verified
Preferred Language
-
English - Fluent
-
Hindi - Fluent
Available Timezones
BROWSE SIMILAR DEVELOPER
-
KULJIT S
Corporate Mgmt. – PMG, HR, legal, MIS/ERP
-
Menashe B
Mule ESB / Anypoint Platform / API-led Architecture / Integration Expert
-
Tommy L
Senior System Software Engineer
-
Ray G
Jack of all trades, master of several.
-
Daniel M
Mainframe Developer/Senior QA Analyst
-
Steven T
Have coded almost everything from firmware through apps, dev to valid to customer suppport
-
Mikhail B
Seniors Micro-Services consultant
-
James B
Managing Director, Sr PM, Consultant
-
RICHARD V
Electronics Circuit Design Engineer
-
MICHAEL H
SENIOR MANUFACTURING TEST ENGINEER