About Me
Data Engineer experienced on building ETL pipelines using Scala/ PySpark, REST API development using Python Django and Flask, Successfully deployed web applications and jars on AWS along with CICD Jenkins. Having knowledge of Machine learning...
Show MoreSkills
Software Engineering
Web Development
Data & Analytics
Programming Language
Development Tools
Database
Others
Software Testing
Operating System
Graphic Design
Portfolio Projects
Company
Virtual Log Analysis
Description
Developed Flask REST APIs to collect data save it in csv files also sending to Kafka topic asynchronously, Extracted data from Kafka using Spark Streaming applying aggregations to find the idle and working users sinking the details in csv file for visualizing it. Also performed batch processing on the collected data to get the system usage and calculating actual working hrs deployed application on AWS. Modelling the Data to be saved in MySQL, Automated the setup/installation process using shell scripting.
Show More Show LessCompany
Google Sheets Data Streaming
Description
Extracted data from multiple google sheets collected from CodIn club, feedback, and other forms from google drive directory and sending it to Kafka and streaming using Py-Spark. Applying Machine learning to categorize feedback as positive, negative, or neutral to understand which batches organization has to work more and give more time.
Show More Show LessCompany
Bridgelabz Chatbot
Role
Backend Developer
Description
Deployed chatbot model using Python Flask on AWS. Creating Rest API to take chat messages as a request and returning the predicted message as a response. API for downloading the data/questions and feedback collected through Chatbot UI as csv files for the marketing Team.
Show More Show Less