About Me
Big data - spark, Kafka,hbase,hive,mapreduce,oozie,sqoop (4 years)
Java j2ee - 6 years
Scala - 1 year
... Show MoreSkills
Programming Language
Others
Database
Web Development
Development Tools
Data & Analytics
Software Engineering
Mobile Apps
Operating System
Networking & Security
Portfolio Projects
Company
Edge Cache - Real Time Streaming project
Description
EdgeCache is specifically designed to meet the requirements of Charter Communications LLC, which incorporates lambda architecture. System contains a batch layer to import data from Oracle to Hive and a speed layer for analysing the user information and channel subscription in real time and save the data into HBase.
Show More Show LessCompany
Time Sensor Data Aggregation
Description
Existing implementation of the system has had performance issues with data retrieval of time sensor data at HBase layer and was unable to meet the SLA timelines. The new approach brought the concept of data aggregation to improve the retrieval time at HBase layer. User will be able to generate the reports for Daily, Weekly, Monthly, Yearly etc. with the data aggregation approach and meet the SLA timelines.
Show More Show LessSkills
Map Reduce HBase Java (All Versions)Tools
EclipseCompany
Teradata Data offload
Description
Ace Hardware plans to migrate a set of tables in Teradata to HDFS. The Tables migrated to HDFS will be stored in Hive/Impala tables. The migrated tables will be queried and joined together by Webfocus module to produce the required reports. Migration activity includes scheduling mechanism to pull the data at regular intervals. Incremental logic, compression techniques are incorporated to improve the overall performance of the system.
Show More Show LessSkills
Hive Apache Sqoop ImpalaTools
HiveCompany
Data Ingestion Framework
Description
Data ingestion framework is a module which is integrated to an existing product of Cognizant. The product is aimed to leverage the capabilities of SparkSQL to migrate the data from various types of source to various types of destinations. The module will also provide flexibility for the user to perform various types of transformations like sorting, aggregation, filters etc in between before the source data is being transferred to destination. The module will optimize the whole pipeline flow by analyzing and merging the intermediate transformation phases together, if possible.
Show More Show LessSkills
Java (All Versions) Apache SparkTools
EclipseCompany
Grocery Home Shopping
Description
Support Project
- Analyze the existing application and provide support to the clients
- Providing the on call support for high priority issues and guide it to the resolution
- Worked as part of ATG, Content Administration modules
- Daily catch up with the clients for gathering the top priority issues f
- Mentor the subordinates for the assigned tasks completion
- Identify the value adds which can be added to the existing production system
Skills
Java (All Versions)Tools
EclipseCompany
Foreign Exchange International Payments
Description
- Analyze and gather the requirements for the product implementation
- Design the proposed solution for the data migration framework
- Prepare the unit test cases for the workflows
- Plan and coordinate local and offshore team on design and development
- Prepare the class and sequence diagrams for the identified use cases
- Plan and estimate the tasks from the gathered requirements document
- Mentor the subordinates for the assigned tasks completion
Tools
Eclipse