This is a insurance project implemented on Azure. Migrated existing information mappings to Azure data factory pipelines and then store whole data in Modern data Warehouse for reporting

It's a Marketing Analysis projects using various Azure Services to get Lead, Opportunities.

Worked on Azure Databricks on banking datasets.

Worked on Informatica ETL to create mappings.

Involved in creating piplelines in ADF. Manage Azure Blobs and ADLS. Implemented the hive partitions, bucketing, hive joins. Executing the Hive queries in Apache Spark for increasing performance. ? Implemented Queries in Pig Scripts for analyzing the large data sets. ? Involved in Cluster maintenance, Cluster Monitoring and Troubleshooting.

Scalability Remediation is an agile project that runs with a 2 weeks sprint.PACE/smoke testing team runs Informatica batch jobs and verifies performance, business rules etc. If a batch job fails, we will be notified by corresponding user/team. Based on the issue, a JIRA bug will be created. We have to analyse the issues by checking SYSOUT and Workflow/Session log and identify the root cause. Also We are doing performance tuning activities on the long running batch jobs using java/Hadoop/Spark and thereby minimizing the execution time. Store & Analyse large volume of Big Data(structured,un structured) with Hadoop ecosystem tools (HDFS, Map Reduce, Pig, Sqoop, Hive, HBase, Flume) , Core java, MySql.

The project VM is a in-house project for V.M.Processor Inc (Boston, USA). It is a web based service covering valuation of Real Estate, Inventory, Machinery & Equipments , collateral monitoring services on Borrowing Base, Enterprise Valuation, Financial Analysis, audit, Information Exchange on white papers, facilitating services for lenders. It has various modules such as inventory management, Accounts Receivable(AR), Machinery & Equipments(M & E), Borrowing Base, Find a lender, find a Buyer/Seller etc.