Design and Develop analytic solution for Pfizer genomic data.

Developed backend solution for pfizer CRM solution.

Data Import exports .

Developed framework for data transformations.

Description:

Daimler Center of Excellence team enables analytics solutions internally across the Daimler. We have set up on premise Hadoopcluster to solve data analytics solutions both batch and real time.

We have set up Analytics and AI platform in Azure cloud and successfully migrated from on premise to Cloud.

Successfully roll out cloud solutions using BYOK enabled encryption across the technologies. Set up data governance rules and platform usage and access. Enabled new cutting edge technologies like Block Chain, H20,Data IKU, event hub technologies.

Connected cars developing the apps and display in the Head Unit of the car using AKS, APIM , APPGW, Spring boot technologies.

Roles & Responsibilities:

• Design and develop platform architecture and provide solutions to the projects.
• Set up the azure cloud set up and define the process for Azure Data Lake and Analytics platform.
• Created the centralized OMS dashboard to monitor difference Azure subscriptions.
• Set up Key vault and Service principle for the each source and use cases.
• Experience on deploy HDInsight cluster using ARM templates.
• Discussed with Project teams and validate project architecture and provide suitable solutions.
• Set up capacity queue for all projects based on the utilization, dynamic queue creation.
• Working as Hortonworks coordinator.
• Resolve customer & project architect clarifications and change architecture based the cluster set up.
• Installation andconfigured Hadoop, HDF,Dasense clusters.
• Change the configurations based on the customer needs, without effecting to the other projects.
• Implemented Capacity Queue Management, Quota Management successfully.
• Provided L2 and L3 support for critical issues.
• Install Network SSL certifications both source and Hadoop side.
• Implemented SMARTSENSE recommendations for cluster performance tuning.
• Coordinated with Hortonworks and applied required security, critical issues patches to the cluster.
• Designed migration plan and successfully migrated from HDP 2.4 to HDP 2.5.
• Developed shell script for edge node clean up and logs clean up.
• Design best practices for each service in the cluster and published to projects teams.
• Professionalize the projects and successfully deploy the applications in Hadoop cluster.
• Designed and developed data ingest factory model to ingest data very easily with minimal set ups.

Description:

Apple is maintaining ITunes transactional data in Teradata DW system but as per the performance and memory bottleneck they are replacing using Hadoop Hive. They are extracted data from OLTP system and loaded into Hive in incremental basis and full refresh after applying ETL transformations. Once F2C completed they are created workflows and populates data into semantic layer for Analysis purpose, after that created Oozie workflow and populate the aggregates for the reporting purpose. Apple creating reports for vendor based, royalty based, transaction based etc , reports are visualized using Tableau tool . The reports embedded with R analytics algorithms and published to iPhone, iPad, Laptop users directly.

Responsibilities Undertaken:

• Understand the SRS and prepared technical specification document.
• Design and Develop ETL and DWH workflows using Teradata and Hive.
• Working as offshore coordinator and communicate with Onsite team as well client.
• Design and develop the Hive DDL according to Data source and DW Schema.
• According to Data workflow define Incremental and full refresh tables.
• Design and Develop data model for both Hive and Cassandra databases.
• Design and Develop ETL workflow in Hive using Oozie workflow.
• According to business flow change modify Oozie workflow.
• Developed scripts extract data from Hive to downstream applications.
• Design and Developed Tableau Reports and implemented R integration.
• Involved in Resolving Production issues.
• Developed complex queries for Reports like royalty, Icharts etc.
• Involved in Unit Testing.

Involved in RFP preparation and Design new architectures for upcoming projects

Description: Walmart built an analysis platform for different business domains, including assortment, next gen pricing, retail link, space management, Competitor analysis and Enterprise inventory etc.

Create a Hadoop supported environment with Horton works distribution and data ingestion from different sources and different kinds of data. Create a workflow to process data and visualize advance analytical results and publish reports automatically to decision makers.

Roles and Responsibilities:

• Understand the Business need plan the Hadoop cluster and developed autosys jobs.
• Installed and configured multi-nodes Hadoop cluster
• Involved in installing Hadoop Ecosystems.
• Configured and installed multiple data sources into Hadoop like Sqoop, NFS, Flume etc.
• Commission and De commission the data nodes based on the data velocity and business requirement.
• Involved in Quota Management, User Creation and Permissions.
• DSR,MSR metrics prepared about cluster status like HDFS space, Jobs submitted etc .
• Involved in solving production defects.
• Involved in performance tuning, Cluster monitoring etc.
• Configured Capacity Scheduler based on the business need.
• Support for the Dev, QA and Production environments,whenever any issues occurred.
• Create user profiles based on template and provided the access based on the requirement.
• Configured Kerberos security.
• Configured the Ecosystems like Hive, Pig, HBase, Sqoop, Flume, Tableau.
• Monitor the cluster Health status and kill the long running jobs.
• Resolving the production tickets using JIRA.
• Adding and removing cluster nodes, cluster planning, performance tuning, cluster Monitoring, Troubleshooting.
• Involved in HDFS maintenance and administering IT through Hadoop-Java API.
• Configured Fair Scheduler to provide service-level agreement for multiple users of a cluster.
• Maintaining and monitoring cluster, loaded data into the cluster from dynamically generated files using Flume and from relational database management system using SQOOP.
• Managing nodes on Hadoop cluster connectivity and security.