About Me
· Data Engineer with a master’s in Data-Management & Data Mining and having 3.6 years of overall working experience in Cloud Application Development, Implementing Data-Ser...
· Extensively worked using cloud platform Amazon Web Services and Google Cloud Platform along with wide and in depth understanding of most of the Data Management services.
· Carry out ETL operation, consuming batch and real-time data from various data sources and loading into data stores using python data pipeline on AWS and GCP.
· Empirical experience in handling High-Data-Flow Streaming, Storage and Data Processing using integrated framework like Kafka, Hadoop / Spark, SparkSql and Standalone system Oracle 18c, AWS Redshift.
· Operational experience in various Data Management task such as Data Migration, Data ware-housing and OLAP (Oracle), Talend.
· Involved team member in building machine learning models for solving financial / bank related problems like Cross-selling, upselling, Customer Segmentation and Quartile Analysis for process improvement.
· Experience in data visualization and business intelligence using TABLEAU and KNIME.
Show More
Skills
Web Development
Data & Analytics
Development Tools
Programming Language
Database
Software Engineering
Others
Positions
Portfolio Projects
Company
aca atlanta
Role
Software Architect
Contribute
• Automated creation of data proc cluster for data processing. • Writing data pipeline for consuming the data from source. • Transforming and Filtering the data as per requirements. • Loading the data
Description
This project involves designing an architecture for establishing data flow from client multitenant databases (oracle 18c) to stage on Google Data Store for OLAP on BigQuery.
· Automated creation of data proc cluster for data processing.
· Writing data pipeline for consuming the data from source.
· Transforming and Filtering the data as per requirements.
· Loading the data in Datawarehouse.
Show More Show LessSkills
AWS Google Cloud PythonTools
IntelliJ IDEACompany
aqu intelligent water quality monitoring system
Role
Mobile Developer
Contribute
Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
Description
AQU is real time sense cloud-based solution facilitates water quality measurement right at the pond. It provides an array of parameter to let you know present and future water quality of pond.
Responsibility-.
· Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
· Building Predictive Model for Predicting derived water quality parameters vetted against historical data using Python Scikit,Neural network and Regression.
Show More Show LessSkills
API Gateway AWS Node.Js Redshift TabaluTools
Eclipse