Now you can Instantly Chat with Midhun!
About Me
8 years of IT experience involving design, development and maintenance of Big Data and Web based applications. 7 years of experience in Big Data, involved in projects on Big Data involving Real-Time streaming, Data Ingestion, Transformation and proce...lved in projects on Big Data involving Real-Time streaming, Data Ingestion, Transformation and processing and administration of big data clusters Having knowledge on Linux, Shell Scripting cron job configuration Have worked in Hadoop, HBase, Solr, Spark, Hive, Sqoop, Flume, Kafka, Oozie Have worked with Cloudera Impala, Apache Nifi Experience in Pyspark, Map Reduce Programming models. Having good knowledge in HBase NoSQL Experience in development of Applications related to HBase and other big data technologies Involved in Research and evaluation of big data technologies Capable of processing large sets of structured, semi-structured and unstructured data in Hadoop platform Worked on streaming the data into big data land scape from various sources using Spark, Flume. Having knowledge in Apache Solr. Experience in Cloudera Cluster installation and configuration Very good experience in monitoring and managing the Hadoop cluster using Cloudera Manager Experience in Oozie workflow creation and job scheduling Having knowledge in Sqoop for transferring data from RDBMS to Hadoop platform Experience in PostgreSQL Database. Experience in web services and Java Possessing good communication skills, Interpersonal skills, self-motivated and deep learner.
Show MoreSkills
-
-
-
-
-
-
-
-
- 5 Years
Intermediate
-
- 7 Years
Expert
-
-
-
-
- 8 Years
Expert
-
-
-
-
-
-
-
-
-
-
-
- 9 Years
Advanced
-
-
- 10 Years
Advanced
-
-
- 8 Years
Advanced
-
-
- 8 Years
Advanced
-
-
- 8 Years
Advanced
-
-
-
-
-
-
-
-
-
-
-
- 9 Years
Advanced
-
- 5 Years
Intermediate
-
-
- 9 Years
Advanced
-
- 8 Years
Expert
-
- 7 Years
Intermediate
-
-
-
-
-
- 7 Years
Advanced
-
-
-
-
- 6 Years
Advanced
-
-
-
- 4 Years
Intermediate
-
- 4 Years
Intermediate
-
-
- 4 Years
Intermediate
-
-
- 6 Years
Advanced
-
-
-
-
-
-
-
- 7 Years
Intermediate
-
- 4 Years
Intermediate
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- 7 Years
Advanced
-
-
- 5 Years
Advanced
-
-
-
Positions
Portfolio Projects
Description
Realtime streaming framework that makes the streaming process simpler and more productive. IRS offers guided UI for the end to end data pipeline creation, execution and monitoring. Possible to implement data pipe line using Spark, Kafka, Flume, Twitter, REST and others.
Show More Show LessDescription
The logistics dashboard application is designed to ingest and process data files to big data environment. The input files that are ingested are transformed to use full format, before being inserted in various HIVE tables. Those tables are eventually querying to build useful reports for the marketing team.
Show More Show LessDescription
Scope of this project is to migration of the Log data storage from SQL Server to Big Data platform. The core storage medium in this project is Apache HBase on top of Hadoop Distributed File System.CXF Web service is the agent between Hadoop cluster and client for the save and search operations
Show More Show LessDescription
Proposal for processing Medical Big Data. This PoC deals with proposal for implementing a Hadoop eco system for storing the medical data from various sources like hospitals, clinical Labs and other health organizations. In the analysis phase, process the medical data and identify or predict the medical related information based on user requirements
Show More Show LessDescription
Proposal for handling the telecommunication data in the big data perspective. Industry generates and stores a large amount of data. POC for the identification of fraud users, Frequent Network failures, and other telecom related information from the data using Map Reduce concept.
Show More Show Less