Now you can Instantly Chat with Mohamed!
Skills
Portfolio Projects
Description
• Created the ADF pipelines to pull the large volume of data from SAP HANA to Azure Data Lake Store 2.
• Created the ADF pipelines to load files from the ADLS to Azure BLOB for MOSAIC BI Utilization.
• Worked extensively on the creation of ADF Pipelines, Datasets, Activities, Linked connections, Data Bricks Notebook, Azure Data lake Store, Azure Key Vault, Azure SQL Datawarehouse.
• Mounted the ADLS file System into Azure Databricks Notebook.
• Created the Azure Data Bricks Notebooks to merge the ADLS year wise files into Single ADLS compressed files as a Parquet format using the Scala Code.
• Processing has been done for the Delta files in Azure Data Bricks Notebook.
• Created the Automated Incremental Single Pipeline for all the tables to perform the incremental data load based on the metadata table into ADLS2 files.
• Monitored the ADF Pipelines of the data movement between multiple activities to trace the run details.
• Created the External table in the Azure SQL Data warehouse to pull the ADLS 2 files into Azure SQL Data warehouse.
• Created the Store Procedure and automated in the ADF to perform the incremental load into the Curated Data layer.
Show More Show LessDescription
Actively Participate on the creation of Data Modelling with the Architect.
• Implemented the Azure new environment for the data orchestration.
• Worked extensively on the creation of Pipelines, Datasets, Activities and Linked connections.
• Worked on Azure BLOB creation as dynamically and feeding the data with new delimiter into it.
• Created the ADF pipelines to pull the data from the On-premises SQL Server to Azure SQL Database.
• Monitored the ADF Pipelines of the data movement between multiple activities to trace the run details.
• Created the Store Procedure to perform the incremental load.
• Worked on Alert & Metrics for Email notifications to send the failure status of the specific pipelines to the specific account group.
• Established the connection between Azure SQL Database tables to load data into the Salesforce Inbuilt and custom Objects.
Show More Show LessDescription
• Created the SSIS packages to feed the transactions data from oracle to SQL Server.
• Implemented the Data Vault to load the historical data from various toll systems.
• Enterprise Data Warehouse has been constructed in the structure of Hub, Satellites and Links to fit the core business entity.
• Surrogate Key, Business Key, Relationship between entities constructed along with Load Date\Time Stamp and Record Source attributes.
• Implemented the Linked Server connection from Oracle Server into SQL Server
• Created the dimension model to load the transactional data for all the toll plazas with different vendors lookup tables.
• Control tables and customized logs are implemented for every execution of the packages.
• Created the store procedure to load the transaction that arrives on later.
• Involved on typical incremental load of the data for warehouse.
• Configured the Jobs to run on every 2 hours basis to capture all the vehicles transaction details based on later sync.
• Monitored the data movement and does fix in case of any failures.
Show More Show LessDescription
• Created the complex stored procedure to pull the data from various excel and used to JSON Format like OPENJSON, JSONParse functions to OLTP System
• Created the SSIS Package for the further ETL Process from the OLTP to OLAP in the Azure SQL Server.
• Created the Complex views, User defined Table types to avoid the temp tables in the Stored Procedure.
• Orchestration of the ETL flow has been done in the Azure Data Factory.
• Invoked the SSIS Packages from the On-premises to Cloud using Azure Data Factory and made as automation process.
• Worked on the SQL Data, File Format to Blob Storage and Vice versa.
• Worked on Role Based Access (RBAC) in Azure and SQL Server.
• Created the Cube for the Analytics and view as Dashboard in the PowerBI.
• Worked on the Date Dimensions on SSAS and Calculated Measures and Filters in MDX.
• Developed T-SQL, User-defined functions, Joins and stored procedures with multi-valued parameters for generating complex reports.
• Create SSRS reports according to user requirements and technical standards.
Show More Show LessDescription
• Created SSIS Packages using Pivot Transformation, Fuzzy Lookup, Derived Columns, Condition Split, Term extraction, Aggregate, Execute SQL Task, Data Flow Task, Execute Package Task etc. to generate underlying data for the reports and to export cleaned data from Excel Spreadsheets, Text file, MS Access and CSV files to data warehouse
• Created Fact and Dimension Tables by SSIS packages to clean and load data to Data Warehouse.
• Developed T-SQL, User-defined functions, Joins and stored procedures with multi-valued parameters for generating complex reports.
• Create SSRS reports according to user requirements and technical standards.
• Developed Query for generating drill down reports in SSRS 2012/2008 R2.
• Designed and implemented stylish report layouts.
• Created Multiple Parameters like Dynamic, Cascading, Multivalued, Unbound and Dynamic Hiding Column using parameter.
• Creating dashboards consisting of grids, charts and reports.
• Generated Reports using Global Variables, Expressions and Functions for the reports.
• Identified and worked with Parameters for parameterized reports in SSRS 2012/2008.
• Created multiple reports with drop down menu option having complex groupings within the report.
• Developed reports and deployed them on server using Reporting Services Configuration Manager to generate all daily, weekly, monthly and quarterly Reports including current status.
• Customize output formats from SSRS to Excel, PDF, and CSV.
• Rendering the reports to PDF formats as per the requirement and printing all the reports in a batch process for Monthly Statements.
• Developed Multi-dimensional Objects (Cubes, Dimensions) using MS Analysis Services (SSAS).
• Responsible for Process CUBE Partitions and Dimensions.
• Experience in Developing and Extending SSAS Cubes, Dimensions and Deploying and Processing SSAS objects.
• SSAS storage and partitions, and Aggregation, calculation of queries with MDX, developing reports using MDX and SQL.
• Created the Time Dimension that used to track the Hourly based Transactional data in SSAS.
Show More Show LessDescription
• Created multiple reports with drop down menu option having complex groupings within the report.
• Generated matrix reports, drill down, drill through, sub reports, chart reports, multi parameterized reports.
• Handful experience in working with the new concept of Tablix Data Regions, in the Report Layout.
• Developed reports and deployed them on server using SQL Server Reporting Services (SSRS) to generate all daily, weekly, monthly and quarterly Reports including current status.
• Rendering the reports to PDF formats as per the requirement and printing all the reports in a batch process for Monthly Statements.
• Used Notification services to generate error messages and send them to the user through e-mails, pager messages, and PDA as well as window messengers.
• Scheduled Cube Processing from Staging Database Tables using SQL Server Agent.
• Optimized cubes for better query performance.
• Aggregated cube with 40% performance for better performance.
• Responsible for defining calculated members.
• Developed Multi-dimensional Objects (Cubes, Dimensions) using MS Analysis Services (SSAS).
• Responsible for Process CUBE Partitions and Dimensions.
• Experience in Developing and Extending SSAS Cubes, Dimensions and Deploying and Processing SSAS objects.
• SSAS storage and partitions, and Aggregation, calculation of queries with MDX, developing reports using MDX and SQL
• Conducted and automated the ETL operations to Extract data from multiple data sources, transform inconsistent and missing data to consistent and reliable data, and finally load it into the Multi-dimensional data warehouse.
Show More Show LessDescription
• Created multiple reports with drop down menu option having complex groupings within the report.
• Generated matrix reports, drill down, drill through, sub reports, chart reports, multi parameterized reports.
• Handful experience in working with the new concept of Tablix Data Regions, in the Report Layout.
• Developed reports and deployed them on server using SQL Server Reporting Services (SSRS) to generate all daily, weekly, monthly and quarterly Reports including current status.
• Rendering the reports to PDF formats as per the requirement and printing all the reports in a batch process for Monthly Statements.
• Used Notification services to generate error messages and send them to the user through e-mails, pager messages, and PDA as well as window messengers.
• Scheduled Cube Processing from Staging Database Tables using SQL Server Agent.
• Optimized cubes for better query performance.
• Aggregated cube with 40% performance for better performance.
• Responsible for defining calculated members.
• Developed Multi-dimensional Objects (Cubes, Dimensions) using MS Analysis Services (SSAS).
• Processed cube to perform incremental updates.
• Designed, Build the Dimensions, cubes with star schema using SQL Server Analysis Services (SSAS).
• Responsible for Process CUBE Partitions and Dimensions.
• Experience in Developing and Extending SSAS Cubes, Dimensions and Deploying and Processing SSAS objects.
• SSAS storage and partitions, and Aggregation, calculation of queries with MDX, developing reports using MDX and SQL
• Conducted and automated the ETL operations to Extract data from multiple data sources, transform inconsistent and missing data to consistent and reliable data, and finally load it into the Multi-dimensional data warehouse
SQL Server 2012, SSAS 2012, SSRS 2012, MS Team Foundation Server , MS Excel Power pivot
Show More Show Less