About Me

Very good IT industry experience of 16 years into major areas of SQL, Data Warehousing and Data integration projects, Writing ETL pipelines in Python, Informatica, Pentaho, Talend and other ETL products / technologies. Well versed with Data engineeri... Informatica, Pentaho, Talend and other ETL products / technologies. Well versed with Data engineering methodologies, building data pipelines, maintain data pipeline architecture. Extensive experience and hands on SQL Performance tuning, ETL optimization. Good experience in developing re-usable ETL code snippets using Python. Very good hands on in writing complex SQL Queries, tune the queries, and design database for better performance of queries. Good experience in Data analysis and Data modelling, DWH design, Data Lakes, and project planning. Good experience writing spark code and spark-SQL/streaming for faster data processing and there by generating reports. Extensive experience with Snowflake Snowpipes configurations and event notifications on AWS S3. Experience in Big Data platforms such as Snowflake & Databricks. Working experience with Spark using Python and designing ETL pipelines to process humungous datasets. Very good hands-on experience in interacting with cloud services like AWS S3, Redshift, EMR & AWS Lambda & Glue jobs. Very good experience in designing ETL frameworks, ELT methodology for various projects / purposes. Well known skill for issue resolution till the closure. Worked on several mini projects during ISB tenure such as: Twitter sentiment analysis, Cryptocurrency data analysis, Gender prediction using facial recognition through Deep Learning, Natural Language Processing, Data mining, Building recommendation systems, Statistical analysis and so on...