Arun A.

Arun A.

Big Data Engineer

Kolkata , India

Experience: 5 Years

Arun

Kolkata , India

Big Data Engineer

22952.5 USD / Year

  • Immediate: Available

5 Years

Now you can Instantly Chat with Arun!

About Me

Data Engineer with over 5 years of extensive hands on experience designing cloud based Data solutions and related fields.

-> I have expertise in following.

Programming Languages - Python, SQL
Big Data - spark, Pyspark, spark SQ...

Programming Languages - Python, SQL
Big Data - spark, Pyspark, spark SQL, Hadoop
Azure - Azure Databricks, Azure Data Factory, Azure Data Lake, Azure SQL     Database, Azure synapse
AWS - AWS S3, AWS EMR, AWS Redshift
Scheduling Tools - Airflow

-> Certification: 
Microsoft Certified Azure Data Engineer, 
Microsoft Azure Data Fundamentals, 
AWS Certified Cloud Practitioner

-> Below are few of my responsibilities.

Designed and Developed end-to-end Enterprise Data Analytics Solution on Azure native services like Azure Data Factory, Azure Databrick (pyspark, sparkSQL) and Azure synapse Analtyics.

Developed a API for data cleaning, metadata validation on large scale data using python and Spark(Pyspark) on Azure Databricks, which helped in reducing ELT pipeline computation time by a factor of 10.

Build and maintain scalable ETL pipelines on AWS Glue, to extract data from multiple legacy source systems( SQL, NoSQL), loading into AWS S3, AWS dynamoDB and analyze data using interactive queries on AWS Athena.
 

Show More

Portfolio Projects

Enterprise Data Analytics

Company

Enterprise Data Analytics

Role

Software Architect

Description

Worked as a Azure Data Engineer on an Enterprise Data and Analytics Project for a Fortune-50 US-based retail Client.

Show More Show Less

Customer 360

Company

Customer 360

Role

Software Architect

Description

Worked as a Big Data Engineer for a US - based Telecom client

Show More Show Less

Delta Lake

Company

Delta Lake

Description

Worked as a Big Data Engineer. Used to existing source systems to develop delat Lake on top of Azure Data Lake using Azure Databricks.

Show More Show Less
Share: