About Me

I have strong experience with the Following technologies 
Programming Languages:  Python, SQL,
Python libraries: pandas, NumPy, scipy, pytz, matplotlib, os, csv, pyscopg2, mysql.connector, sqlalchemy, p...libraries: pandas, NumPy, scipy, pytz, matplotlib, os, csv, pyscopg2, mysql.connector, sqlalchemy, pyautogui
Cloud: Aws services - S3, ec2, Lambda, Sqs, SNS, Cloudwatch, API gateway, ECS, ECR, IAM, RDS - Postgresql, SES
Others: Github, Docker, JIRA, Flask, Django

Role and Resposibilties

• Building end-to-end data pipeline from scratch using Python and AWS services 
• Writing clean and optimize AWS lambda functions using python. 
• Building the lambda packages
• Converting server application to serverless 
• Developing the new functionalities for the project 
• Production deployments

Projects
Document Digitization (extracting data from pdf and convert it into the csv, json, xml format)

• Build the end-to-end data processing pipeline using AWS Lambda, s3, sqs. 
• Developed the automated pipeline for reporting using AWS lambda, PostgreSQL, python, SES

PDF data extractor (extract the data from pdf)
        build a complete end to project with backend and front end

• For the backend I have used flask, python, pandas, openCV to extract the data and the Mysql database to store this data 
• For the frontend, I used the bootstrap, html, css, jinja templating language
• for hosting this website I used the aws ec2 instance

Predictive works ( The aim of the project is to predict the anomalies before occurring it)

• In this project, I have build end to end data collection ETL pipline 
• This pipeline fetches the data from different databases and stores it in the s3 bucket. 
• The code host on the AWS lambda and written in python it fetches record from different production database and store in s3 bucket