Debarun B.

Debarun B.

12 years of Experience in developing Datawarehouse & ETL, Data Engineering & Data Science solutions.

, Singapore

Experience: 12 Years

Debarun

12 years of Experience in developing Datawarehouse & ETL, Data Engineering & Data Science solutions.

134400 USD / Year

  • Start Date / Notice Period end date: 2020-10-01

12 Years

Now you can Instantly Chat with Debarun!

About Me

12 years of experience of developing Database Applications, Datawarehouse / ETL / BI reporting solutions with various IT service providers using SQL, TSQL, SQL Server, Snowflake, AWS Redshift, Google BigQuery, MSBI stack (SSIS, SSAS, SSRS), Penta...

Show More

Portfolio Projects

Description

• Data Integration framework development to extract data from Oracle database, SFTP server and Rest API End point and load into Enterprise Datawarehouse database using SSIS, SQL Server.
• ETL framework development to implement ABC (Audit-Balance-Control) framework for loading data from multiple source systems to Enterprise Datawarehouse database using SSIS.
• Establish robust framework, directory structure and data retention strategy to download encrypted data files, decrypt and unzip encrypted data files and load data from the unzipped data files to Enterprise Datawarehouse database using SSIS.
• Design datawarehouse database objects like tables, views, stored procedures, functions and include audit columns in each tables for better datawarehouse database maintenance using SQL Server database.
• Implement data masking to encrypt PII data in Enterprise Datawarehouse database using data encryption using SQL Server database.
• Perform ETL and Datawarehouse database testing and creation of test scripts and share test technique details with the tester to complete the full testing life cycle.
• Perform creation of the report queries for the existing reports to match data between Enterprise Datawarehouse database and existing canned and chart reports to perform the sanity check of Enterprise Datawarehouse database.
• Perform database and ETL code maintenance using Tortoise SVN.

Show More Show Less

Description

• Business Requirement gathering, analysis and documentation for Data Integration and ETL framework, Datawarehouse and BI Reports and Dashboards development.
• Created ETL solution including SSIS packages to extract data from data sources like CSV, excel, Rest API and performed data cleansing and transformation and integration with Salesforce Cloud CRM.
• Created ETL framework with SSIS packages, which includes ETL data pipeline for data extraction from Salesforce CRM Cloud and data integration with Enterprise CRM Datawarehouse Database.
• Used SSIS to perform full load and incremental load and deployed ETL solution and setup SQL Server Agent jobs in DEV/UAT/PROD environments to execute SSIS packages Daily/Weekly/Monthly for data integration.
• Worked as a single stakeholder from Singapore location to help the client to build and look after the overall ETL framework and activities and resolve any issues related to Data Integration / ETL framework for APAC, EMEA, NALA regions.
• Developed CRM Datawarehouse database by using Multi-Dimensional Data Modeling technique and database objects with Microsoft SQL Server 2014 Database with SQL, T-SQL.
• Used SSAS Tabular to build Dimensional Data Model to build Sales Data mart.
• Used Visual Studio to create maintain scripts for SSIS script tasks and used Postman to test Rest API data.
• Performed complex data analysis and data science activities using Tableau, Power BI and Python (Pandas, NumPy, Matplotlib, Seaborn).
• Maintained database object scripts, SSIS packages, Power BI reports with Microsoft TFS.
• Provided production support to the entire BI system to tackle mission critical issues.
• Used Power BI features like Data Transformation, Data Modeling, Slicers, Hierarchy, DAX formulas to design dashboards.
• Created personal gateways for data refresh, workspaces and content packs for business users, users and groups to provide access to view to reports and dashboards in Power BI.
• Maintained continuous collaboration with the stakeholders to develop dashboards with Power BI based on the Sales KPIs and assured the quality at the same time.

Show More Show Less

Description

• Business requirement gathering and analysis and ETL mapping document development.
• Enterprise Datawarehouse Database and database objects development using Microsoft SQL Server 2014 Database with SQL, T-SQL.
• Created SSIS packages and SSIS script tasks using Visual Studio to extract data from multiple sources like Oracle database, SQL Server, CSV & Excel data files and load into Enterprise Datawarehouse database in both SQL Server & Teradata.
• Developed MOLAP database using SSAS 2014 Tabular model by extracting data from both SQL Server and Teradata databases.
• Involved in Enterprise Datawarehouse Modeling using Financial Service Logical Data Model (FSLDM).
• Performed POCs with Power BI by creating different dashboards using different Power BI features.
• Used Hive to analyze data, stored in Hadoop HDFS and created ETL process with Spark SQL to extract data from Hadoop HDFS and load Cassandra database.
• Used Spark ML job to analyze and create model for Credit card fraud transaction detection and saved the model in Hadoop HDFS.
• Used Spark streaming job to consume credit card transaction data and apply ML model for fraud transaction detection and load the result into Cassandra database.
• Used Airflow to schedule and maintain Spark streaming and Spark ML jobs.
• Performed project task and issue maintenance using JIRA and code maintenance with ClearCase.

Show More Show Less

Description

  • Performed analysis of various source systems and developed high-level document (HLD) and low-level document (LLD) creation for Datawarehouse solution development.
  • Developed Enterprise Datawarehouse Database using Dimensional Data Modeling technique with Microsoft SQL Server 2014 with SQL, T-SQL.
  • Developed ETL framework using SSIS 2012 for loading data into Enterprise Datawarehouse Database.
  • Performed reports and dashboards development using Power BI.
  • Project tasks maintenance using Microsoft Projects and code maintenance using Microsoft TFS.

Show More Show Less