Understand Client’s Business needs and translate them into Functional and Non-Functional Requirements Page 3 of 7

Work parallel with the Client side Architects to design the Architecture of the System.

Design and Develop Data Processing Pipeline in Spring Integration/ Spring Boot

Design the Datamart for the Data Processing Engine

Schema Design for SQL Server Datamart Design and SSIS Data Load Design

Work hand in hand with the team for daily basis developments and integrations

• Design the Architecture of the System
• Understand Client’s Business needs and translate them into Functional and Non-Functional Requirements
• Design and Develop complete microservice driver architecture in Spring Boot with embedded Tomcat as the web deployment container
• Schema Design for the whole use case (storage and reporting requirements)
• Develop Reports and Dashboards in AngularJs

• Design the Architecture of the System 
• Understand Client’s Business needs and translate them into Functional and Non-Functional Requirements
• Design and Develop Data Processing Pipeline in SPARK (Java Driver)
• Schema Design for Hive Data Storage System
• Design KPIs as per the Business needs.
• Develop Reports and Dashboards in Tableau

• ETL based Data Processing Engine using Alteryx, Custom JAVA code, server side MongoDB Javascript
• Full Text based Advanced Search Implementation in ElasticSearch
• Assisted with Schema Design for MongoDB and Elastic Search
• Basic understanding of implementation of BI reports.
• Performance enhancements at various points of data processing and search mechanisms. 
• Development of a one click orchestration layer that collects data, cleans and processes data, applies rule sets and business logics, validates and filters data, does natural language processing and associative graph modeling and presents it to the user on the web-application.

The product is responsible for collection, processing, analysing, and reporting of collected from different social networks like Facebook, Twitter, GooglePlus, Youtube, Instagram. The data collection is based on prespecified keywords or user selected keywords or any user/person on social media. Registered user can see sentiment analysis and trending for different keywords which will be populated based on data collected from different social media.  
 

• Requirement gathering and SOW submission
• Understanding of requirements for business layer
• Creating an architecture for the solution
• Understanding and integrating all the systems by means of a workflow engine, oozie
• Development of Map-Reduce codes
• Development of sqoop jobs
• Administration of BigData cluster 
• Database design for Persistence layer in InfiniDB

The Project includes creating a software product for the secondary and tertiary analysis of data collected from next generation sequencing from DNA samples using SOLiD technology. The analysis comprises mapping and alignment to the reference human genome data, SNP detection, gene counting, small RNA counts and  coverage detection, CNV detection etc.  
   

• Setting up and configuring Hadoop cluster and other involved frameworks like Flume, Sqoop etc.
• Configuring flume nodes for data collection.
• Creating a custom flume decorator for the selective upload of data on HDFS
• Writing Mapper and Reducer for analysis of this data and collecting the required information