Now you can Instantly Chat with Sayali!
About Me
To work hard with full determination and dedication to achieve organizational as well as personal goals and to serve my parents and my country with the best of my abilities and skills. Having around 2+ years of experience in Software Development in J...e best of my abilities and skills. Having around 2+ years of experience in Software Development in Java, Hadoop and Spark Development. Hands on experience BigData Hadoop-MapReduce, Pig, Hive, Hbase, Sqoop, Flume, Hadoop-Yarn, Apache Spark, Scala. Good understanding/knowledge of Hadoop Architecture and its components such as HDFS and MapReduce concepts. Familiar with advance spark feature GraphX, Machine Learning. Importing the data from sql server/oracle to HDFS and exporting too using sqoop. Streaming the unstructured data from web sources using Flume. Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals and can work as part of a team as well as independently. Ability to perform at a high level, meet deadlines, and adaptable to ever changing priorities. Exceptional ability to quickly master new concepts.
Show MorePortfolio Projects
Contribute
1. Responsible for understanding the scope of the project and requirement gathering. 2. Responsible for collecting stb logs using flume, kafka. 3. Analyze the set top box dataset. 4. Set top box logs
Description
1. This Application is used for the analytics of the set top box logs data with optimum performance.
2. Logs data contains both text as well as XML data.
3. The data is stored in the HDFS in distributed manner over a cluster of nodes, which addresses the problems of scalability high availability and fault tolerance.
4. The stb logs are collected using flume, kafka and then process using spark rdd and spark SQL.
5. The architecture solves the problem of limited storage capacity and limited processing capacity, the system is scalable, reliable and fault tolerant.
Show More Show LessVerifications
-
Profile Verified
-
Phone Verified
Preferred Language
-
English - Fluent
-
Hindi - 0
Available Timezones
BROWSE SIMILAR DEVELOPER
-
Doug O
Multi-Cloud, Big Data, Data Analytics and Solutions Architect
-
Art F
Data Architect with Teradata, Linux, SQL, and Python experience
-
SUBBA RAO D
DIRECTOR – PROJECTS / GM – ITC / DELIVERY HEAD / SR. PROGRAM MANAGER/ MIS HEAD/ IT HEAD/ CIO
-
Steven T
Have coded almost everything from firmware through apps, dev to valid to customer suppport
-
Terry L
SAS Consultant
-
MARK O
SENIOR SOFTWARE ENGINEER
-
Nelson L
Senior IT, Telecom, and Operations Executive
-
Olaf C
Senior AI, Cognitive & Automation Architect Azure/Quantum Hybrid Architect
-
BALAJI I
Chief Analytics Officer and Founder
-
Aquiles Alejandro B
Data Scientist