Data Engineer | Online Jobs | Optimhire

Data Engineer

About the Role and ResponsibilitiesYugen is currently an early stage startup with a fast-growing client portfolio. We create scalable and reliable ML Systems and therefore ML Engineering is an extremely crucial part of our work. We are strongly committed to the ‘Every promising model should face the test of reality’ philosophy. We're looking for Data Engineers who will work hands-on and manage technology projects across multiple client engagements. As a Data Engineer, you will be part of the Engineering and Technology function and eventually play a central role in building our MLOps platform. Your key responsibilities will be to - ● Design, build and manage Data Ingestion, transformation and exploration pipelines designed for high throughput/low latency ● Deploy a range of data engineering pipelines into production ● Collaborate with other ML Engineers and Data Scientists during System Design & implementation of Feature Stores and Model Monitoring ● Be result oriented and emphasize on on-time delivery of projects ● Communicate potential roadblocks and trade-offs between performance and complexity upfront ● Mentor other Data Engineers and enable their growth ● Define technology strategy and roadmap for client accounts Key Qualifications ● Knowledge and experience of deploying and maintaining large scale systems in production environments ● 2+ years of hands-on experience in Distributed Computing - Spark, Scala, and Kafka ● Strong programming skills in Python/Java ● Good understanding of data architecture patterns (data warehouse, data lake, streaming) ● 2+ years of hands-on experience in Cloud computing platforms (any one of AWS/Azure/GCP) ● Linux environment, SQL & NoSQL, and Shell scripting ● Clear understanding of Git/version control ● Knowledge of deploying ML models is a plus ● Knowledge of feature stores is a plus


Job Type

Payroll


Must have Skills

  • Python - 2 Years

    Intermediate

  • Scala - 2 Years

    Intermediate

  • SQL - 2 Years

    Intermediate

  • NoSQL - 2 Years

    Intermediate

  • Shell Scripting - 2 Years

    Intermediate

  • Apache-Kafka - 2 Years

    Intermediate

  • Data Engineer - 3 Years

    Advanced


Timezones

New Delhi [UTC +5]


Languages

english - Fluent

26 - 41 K/Year USD (Annual salary)

Longterm (Duration)

Fully Remote

India


Aayush A

India