Midhun S.

Midhun S.

Technology Lead – Big Data

Thiruvananthapuram , India

Experience: 10 Years

Midhun

Thiruvananthapuram , India

Technology Lead – Big Data

57600 USD / Year

  • Immediate: Available

10 Years

Now you can Instantly Chat with Midhun!

About Me

8 years of IT experience involving design, development and maintenance of Big Data and Web based applications. 7 years of experience in Big Data, involved in projects on Big Data involving Real-Time streaming, Data Ingestion, Transformation and proce...

Show More

Portfolio Projects

Description

Realtime streaming framework that makes the streaming process simpler and more productive. IRS offers guided UI for the end to end data pipeline creation, execution and monitoring. Possible to implement data pipe line using Spark, Kafka, Flume, Twitter, REST and others.

Show More Show Less

Description

RSS Feed Search Engine is a search engine developed for a client in Azure Cloud, that capable to search the RSS feed keywords for the business requirements. Management need to identify the users feed backs, news and review comments.

Show More Show Less

Description

The logistics dashboard application is designed to ingest and process data files to big data environment. The input files that are ingested are transformed to use full format, before being inserted in various HIVE tables. Those tables are eventually querying to build useful reports for the marketing team.

Show More Show Less

Description

Data Migration applications are fetching the data from the various data environment to Hadoop stack. Sqoop, Flume, Solr and other migration tools are used based on the client requirements. The data fetch jobs trigger using commands, shell scripts, Oozie workflows.

Show More Show Less

Description

An application that can take and process data using the components like kaka, flume, Spark, Cassandra

Show More Show Less

Description

An application for transferring the data from the Oracle to Mongo DB using apache Nifi

Show More Show Less

Description

Scope of this project is for creating a central repo for all type of data from the various sources

Show More Show Less

Description

Scope of this project was for fetching the data from the Teradata environment to Hadoop stack. The data fetch jobs are triggering in daily manner by the Oozie scheduler

Show More Show Less

Description

Scope of this project is to handling the test reports of the engine quality tests. The reports are in the Microsoft excel formats .The main use case is need to parse the excel data and ingest to the hive tables

Show More Show Less

Description

Scope of this project is to give a search engine utility to the user, when each incident is created in the database import the data to the solr and search the documents and give mail alert to the user for similar records

Show More Show Less

Description

Scope of this project is to migration of the Log data storage from SQL Server to Big Data platform. The core storage medium in this project is Apache HBase on top of Hadoop Distributed File System.CXF Web service is the agent between Hadoop cluster and client for the save and search operations

Show More Show Less

Description

Scope of this project is the storage and analysis of apache logs. Log data will store in to the HDFS directly using Flume. Map Reduce programs are used for the information retrieval from this log files.

Show More Show Less

Description

Proposal for processing Medical Big Data. This PoC deals with proposal for implementing a Hadoop eco system for storing the medical data from various sources like hospitals, clinical Labs and other health organizations. In the analysis phase, process the medical data and identify or predict the medical related information based on user requirements

Show More Show Less

Description

Proposal for handling the telecommunication data in the big data perspective. Industry generates and stores a large amount of data. POC for the identification of fraud users, Frequent Network failures, and other telecom related information from the data using Map Reduce concept.

Show More Show Less