Now you can Instantly Chat with Prayas!
About Me
Team player and quick learner, Result oriented Data Engineer with 2 years experience in Big Data and Machine learning, Back-end development. Equipped with a record of success in Developing and deploying pipelines created using Python/Scala Spark, She...
Show MoreSkills
Positions
Portfolio Projects
Description
Extracted data from multiple google sheets collected from CodIn club, feedback, and other forms from google drive directory and sending it to Kafka and streaming using Py-Spark. Applying Machine learning to categorize feedback as positive, negative, or neutral to understand which batches organization has to work more and give more time.
Show More Show LessDescription
Developed Flask REST APIs to collect data save itin csv filesalsosending to Kafka topic asynchronously, Extracted data from Kafka using Spark Streaming applying aggregations to find the idle and working users sinking the details in csv file for visualizing it. Also performed batch processing on the collected data to get the system usage and calculating actual working hrs deployed application on AWS. Modelling the Data to be saved in MySQL, Automated the setup/installation process using shell scripting.
Show More Show LessDescription
Successfully developed and deployed Flask REST APIs to collect save data in CSV les also sending to Kafka topic asynchronously, Extracted data from Kafka using Spark Streaming applying aggregations to find the idle and working users sinking the details in CSV le for visualizing it. Also performed batch processing on the collected data to get the system usage and calculating actual working hrs deployed application on AWS. Modelling the Data to be saved in MySQL, Also Automated the setup/installation process using shell scripting.
Show More Show LessDescription
Deployed chatbot model using Python Flask on AWS. Creating Rest API to take chat messages as a request and returning the predicted message as a response. API for downloading the data/questions and feedback collected through Chatbot UI as csv les for the marketing Team.
Show More Show Less