Data Engineer

About Yugen 

Founded in 2020 by ex-Silicon Valley, IIT Alumni with prior experience in Tech Consulting and Product Management, Yugen is an early-stage startup in the Data Science and Machine Learning Engineering space. Simultaneous adoption of Algorithms, Engineering, and Responsible AI will shape the future, and Yugen’s vision is to be at the forefront of that trend. We are working towards becoming India’s leading player in the Data Science and MLOps consulting space over the next 4-6 years. 

About the Role and Responsibilities 

We're looking for Data Engineers who will work hands-on and manage technology projects across multiple client engagements. As a Data Engineer, you will be part of the Engineering and Technology function and eventually play a central role in building our MLOps platform. Your key responsibilities will be to -

· Design, build and manage Data Ingestion, transformation and exploration pipelines designed for high throughput/low-latency· Deploy a range of data engineering pipelines into production

· Collaborate with other ML Engineers and Data Scientists during System Design & implementation of Feature Stores and Model Monitoring

· Be result oriented and emphasise on on-time delivery of projects

· Communicate potential roadblocks and tradeoffs between performance and complexity upfront· Mentor other Data Engineers and enable their growth

· Define technology strategy and roadmap for client accounts Yugen is currently an early-stage startup with a fast-growing client portfolio. We create scalable and reliable ML Systems and therefore ML Engineering is an extremely crucial part of our work. We are strongly committed to the ‘Every promising model should face the test of reality’ philosophy. 

Key Qualifications 

· Knowledge and experience of deploying and maintaining large scale systems in production environments

· 2+ years of hands on experience in Distributed Computing - Spark, Scala and Kafka

· Strong programming skills in Python/Java· Good understanding of data architecture patterns (data warehouse, data lake, streaming)

· 2+ years of hands on experience in Cloud computing platforms (any one of AWS/Azure/GCP)· Linux environment, SQL & NoSQL, and Shell scripting

· Clear understanding of Git/version control· Knowledge of deploying ML models is a plus· Knowledge of feature stores is a plus