About Me
An enthusiast software engineer graduated from IIT Guwahati and has experience in AI/ML, IoT, Data Engineering, Cloud Computing and IaC (Infrastructure as Code). Always looking to expand my boundaries by exploring new technologies and I am willing...
Show MoreSkills
Programming Language
Data & Analytics
Development Tools
Others
Portfolio Projects
Sentiment Analysis using GCP NLP API
https://harshavardhan-raja.medium.com/sentiment-analysis-using-gcp-nlp-api-66a0ba31df7bCompany
Sentiment Analysis using GCP NLP API
Role
Machine Learning Engineer
Company
Cloud Data Enginner for Teck
Description
1. Worked as Cloud Data Engineer for a canadian mining client TECK.
2. Worked closely with client’s Data Engineering team and helped them in building big data ETL pipelines for migrating data from client’s onprem servers to GCP BigQuery (About 100TB of data is migrated).
3. Created automated disaster recovery tool which backs up DDL and data from selected important bigquery tables and recreates them within minutes when triggered.
4. Built attractive & insightful dashboards with KPIs about the performance of Data Engineering Environment on GCP which are used to present to client’s top management.
5. Created terraform script which is used to create a ready to use VM instance with all the dependencies and libraries installed so that we can use it to develop and deploy CDAP pipelines quickly. This reduced the time to spin up a ready to use CDAP instance from minutes to seconds.