This project delivered the initial set of Client OnPrem and Sales Force data feeds into the Azure Data Lake.

Working with fellow Microsoft partners, with the Business Intelligence/Analytics team, responsible for BI development and the surrounding infrastructure for the UK, USA, Brazil ,APAC ,Australia and South Africa.
Involved in end to end implementation like requirement gathering ,Functional discussion, Data Ingestion ,Data set & frequency setup documentation ,building ETL /ELT Logic for business users and the creation of front end reporting with mobile compatible dashboards using Power BI.

· Actively involved in developed pipelines using Azure Data Factory to ingest data from One Prem(File system),Sales Force Data, amongst others into the ADLS and Different Storage Account.

· These pipelines were delta enabled and had various activities (copy and Transformation) as the data moved from source to target. Worked with data frames to ingest, transform, analyze and help Front end team to visualize data.

· Staging – ELT stage layer where the data is loaded directly from Source files. In this step data are loaded from source files.

· Hierarchy File Build on Top of Dim Data– Pre-defined Files build on staging layer with user-friendly column names.

· In Pre-Core or Collated Layer ,The business logic and Transformation using Databricks,Pyspark and some case USQL Jobs & PowerShell script.

· PowerShell script creation for Storage Access policy check and Access provisioning, ARM template deployment.

· Code repository for the different pipelines, Scripts being maintained using VSTS.

· Involved in Performance optimization in USQL job using Index and Partitioning, applying required filter and conditional Logic.

· Used Assembly in USQL for Diagnostic Log analysis. Pipeline being developed to Track ADLS user access, Storage account user metrics and Power bi report being generated as per user requirement.

This project was started with the existing OnPrem Sqlserver,File based data feeds into the Azure Data Lake first using in ADF v1.

Post ADF V2 GA , the existing jobs with the enhancement or change requests as required by business move to V2 version with Data Lake Store Gen2 & Databricks From Gen1 phase wise make sure client production system not impacted.

Client has it’s exist mixed datasets of relational or File based like Asset,Course offered ,Topic,Usages,Skillset details which all for learning prospect in existing on prem system which need to be moved to Cloud with required transformation.

Health care project related to differnt claim and settlement

Medicine and health care project related to sales and profit from the RX and CX medicine.