Data Engineer

About the Role and Responsibilities

We're looking for Data Engineers who will work hands-on and manage technology projects across multiple client engagements. As a Data Engineer, you will be part of the Engineering and Technology function and eventually play a central role in building our MLOps platform.

Your key responsibilities will be to -

● Design, build and manage Data Ingestion, transformation and exploration pipelines designed for high throughput/low latency

● Deploy a range of data engineering pipelines into production

● Collaborate with other ML Engineers and Data Scientists during System Design & implementation of Feature Stores and Model Monitoring

● Be result oriented and emphasize on on-time delivery of projects

● Communicate potential roadblocks and trade-offs between performance and complexity upfront

● Mentor other Data Engineers and enable their growth

● Define technology strategy and roadmap for client accounts

Key Qualifications

● Knowledge and experience of deploying and maintaining large scale systems in production environments

● 2+ years of hands-on experience in Distributed Computing - Spark, Scala, and Kafka

● Strong programming skills in Python/Java

● Good understanding of data architecture patterns (data warehouse, data lake, streaming)

● 2+ years of hands-on experience in Cloud computing platforms (any one of AWS/Azure/GCP)

● Linux environment, SQL & NoSQL, and Shell scripting

● Clear understanding of Git/version control

● Knowledge of deploying ML models is a plus

● Knowledge of feature stores is a plus