Vishal J.

Vishal J.

Data Engineer

Vellore , India

Experience: 4 Years

Vishal

Vellore , India

Data Engineer

USD / Year

  • Start Date / Notice Period end date:

4 Years

Now you can Instantly Chat with Vishal!

About Me

Data Engineer...

Show More

Portfolio Projects

Description

Extract the data from the pdf le and store this data into the database. Later visualize this data UI This project was running on falsk application le. via UI user can upload le into s3 bucket then lambda gets triggered and data get extracted from upload les and store it into RDS database.

Show More Show Less

Description

Document digitization

  • extracting data from pdf and convert it into different format such as JSON, XML, csv as per customer requirement
  • building end to end pipelines
  • building automation piplines for reporting

Show More Show Less

Description

Design a database schema, Writing models, view/functionality for the application

● Hosing the application on AWS - ec2 windows instance, RDS.

Show More Show Less

Description

The aim of the project is to predict the major incident before occurring.

● Data Collection from different databases

● Writing an ETL script using python.

● Creating an end to end data pipelines.

● Hosting a project in a cloud with Aws services like- S3, ec2, Lambda, Batch.

● Building a Docker image for AWS Batch

● Design a Memory management module using python for AWS lambda.

Show More Show Less

Description

Setup the ELK Stack on the production system.

● Building a single and multimeric machine learning job using Elasticsearch, Logstach, and kibana.

Show More Show Less

Description

Migrating in premises system/setup to cloud.

Migrating Ec2 instances, Dynamo DB tables, elastic cache from one account to another account(STG to PRD) using the AWScloud formation scripts.

● Cassandra Production deployment- Creating, configuring and adding the new Cassandra node into the existing ring

● Jira Administration - Create/update/modify Screens, Workflow, fields, and projects

● Chef installation on different AWS servers

● AWS Trust advisor: - Reduce the billing of the existing system

Show More Show Less