Now you can Instantly Chat with Vikas!
About Me
Data Engineer with a masters in Data-Management & Data Mining and having 3.7 years of overall working experience in Cloud Application Development, Implementing Data-Services architecture (ETL) and Financial Analysis Extensively worked using cloud pla...
Show MoreSkills
Positions
Portfolio Projects
Contribute
• Automated creation of data proc cluster for data processing. • Writing data pipeline for consuming the data from source. • Transforming and Filtering the data as per requirements. • Loading the data
Description
This project involves designing an architecture for establishing data flow from client multitenant databases (oracle 18c) to stage on Google Data Store for OLAP on BigQuery.
· Automated creation of data proc cluster for data processing.
· Writing data pipeline for consuming the data from source.
· Transforming and Filtering the data as per requirements.
· Loading the data in Datawarehouse.
Show More Show LessContribute
Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
Description
AQU is real time sense cloud-based solution facilitates water quality measurement right at the pond. It provides an array of parameter to let you know present and future water quality of pond.
Responsibility-.
· Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
· Building Predictive Model for Predicting derived water quality parameters vetted against historical data using Python Scikit,Neural network and Regression.
Show More Show LessDescription
This project involves designing an architecture for establishing data flow from client multitenant databases (oracle 18c) to stage on Google Data Store for OLAP on BigQuery. Automated creation of data proc cluster for data processing. Writing data pipeline for consuming the data from source. Transforming and Filtering the data as per requirements. Loading the data in Datawarehouse.
Show More Show Less