Hadoop as a service cloud with real-time auto-configuration and automatic scaling instance as per Data processing

cloud backend development with python and Perl language to manage all resources in the cloud environment and updated in real-time with the help of microservice

Designing and implementing Big Data Auto-scaling Cloud Architecture. Designed project infrastructure utilizing Hadoop and Spark Systems Enterprise Architect. Implemented the complete big data pipeline with real-time processing Utilized MapReduce, HDFS, Hive, Pig, Spark, Solr and Apache Tez.

Collaborated with various team & management to understand the requirement & design the complete system Designed and implemented new algorithms for data analysis Designed Data modeling, Data pipeline and configuring ecosystem.

Designing and implementing flow work of Data migration tool. Designing and implementing Elasticsearch cluster. Developed in house Dynamic data handling tool, by using this tool migrate Sarver monitoring RRD data in to Elasticsearch cluster.

Server health data monitoring. Hands on experience in Elasticsearch, Logstash, Kibana and Es-Hadoop. Analyzed, tested and debugged data acquisition systems Hands on experience in Perform data mining, Data analytics technique, machine learning, and python Server Behavior analysis by machine learning technique.