Now you can Instantly Chat with Vikas!
About Me
· Data Engineer with a master’s in Data-Management & Data Mining and having 3.6 years of overall working experience in Cloud Application Development, Implementing Data-Ser...
· Extensively worked using cloud platform Amazon Web Services and Google Cloud Platform along with wide and in depth understanding of most of the Data Management services.
· Carry out ETL operation, consuming batch and real-time data from various data sources and loading into data stores using python data pipeline on AWS and GCP.
· Empirical experience in handling High-Data-Flow Streaming, Storage and Data Processing using integrated framework like Kafka, Hadoop / Spark, SparkSql and Standalone system Oracle 18c, AWS Redshift.
· Operational experience in various Data Management task such as Data Migration, Data ware-housing and OLAP (Oracle), Talend.
· Involved team member in building machine learning models for solving financial / bank related problems like Cross-selling, upselling, Customer Segmentation and Quartile Analysis for process improvement.
· Experience in data visualization and business intelligence using TABLEAU and KNIME.
Show More
Skills
Positions
Portfolio Projects
Contribute
• Automated creation of data proc cluster for data processing. • Writing data pipeline for consuming the data from source. • Transforming and Filtering the data as per requirements. • Loading the data
Description
This project involves designing an architecture for establishing data flow from client multitenant databases (oracle 18c) to stage on Google Data Store for OLAP on BigQuery.
· Automated creation of data proc cluster for data processing.
· Writing data pipeline for consuming the data from source.
· Transforming and Filtering the data as per requirements.
· Loading the data in Datawarehouse.
Show More Show LessContribute
Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
Description
AQU is real time sense cloud-based solution facilitates water quality measurement right at the pond. It provides an array of parameter to let you know present and future water quality of pond.
Responsibility-.
· Established ETL, Data streaming using Amazon services like- Amazon Lambda (NodeJs , JAVA), Aurora, kinesis, S3, Redshift, DynamoDB.
· Building Predictive Model for Predicting derived water quality parameters vetted against historical data using Python Scikit,Neural network and Regression.
Show More Show Less