Developed Flask REST APIs to collect data save it in csv files also sending to Kafka topic asynchronously, Extracted data from Kafka using Spark Streaming applying aggregations to find the idle and working users sinking the details in csv file for visualizing it. Also performed batch processing on the collected data to get the system usage and calculating actual working hrs deployed application on AWS. Modelling the Data to be saved in MySQL, Automated the setup/installation process using shell scripting.

Extracted data from multiple google sheets collected from CodIn club, feedback, and other forms from google drive directory and sending it to Kafka and streaming using Py-Spark. Applying Machine learning to categorize feedback as positive, negative, or neutral to understand which batches organization has to work more and give more time.

Deployed chatbot model using Python Flask on AWS. Creating Rest API to take chat messages as a request and returning the predicted message as a response. API for downloading the data/questions and feedback collected through Chatbot UI as csv files for the marketing Team.