Predict Sentiment of reviews stored in GCP BigQuery

1. Worked as Cloud Data Engineer for a canadian mining client TECK.
2. Worked closely with client’s Data Engineering team and helped them in building big data ETL pipelines for migrating data from client’s onprem servers to GCP BigQuery (About 100TB of data is migrated).
3. Created automated disaster recovery tool which backs up DDL and data from selected important bigquery tables and recreates them within minutes when triggered.
4. Built attractive & insightful dashboards with KPIs about the performance of Data Engineering Environment on GCP which are used to present to client’s top management.
5. Created terraform script which is used to create a ready to use VM instance with all the dependencies and libraries installed so that we can use it to develop and deploy CDAP pipelines quickly. This reduced the time to spin up a ready to use CDAP instance from minutes to seconds.