Data Engineer | Online Jobs | Optimhire

Data Engineer

About the Role and Responsibilities

We're looking for Data Engineers who will work hands-on and manage technology projects across multiple client engagements. As a Data Engineer, you will be part of the Engineering and Technology function and eventually play a central role in building our MLOps platform.

Your key responsibilities will be to -

● Design, build and manage Data Ingestion, transformation and exploration pipelines designed for high throughput/low latency

● Deploy a range of data engineering pipelines into production

● Collaborate with other ML Engineers and Data Scientists during System Design & implementation of Feature Stores and Model Monitoring

● Be result oriented and emphasize on on-time delivery of projects

● Communicate potential roadblocks and trade-offs between performance and complexity upfront

● Mentor other Data Engineers and enable their growth

● Define technology strategy and roadmap for client accounts

Key Qualifications

● Knowledge and experience of deploying and maintaining large scale systems in production environments

● 2+ years of hands-on experience in Distributed Computing - Spark, Scala, and Kafka

● Strong programming skills in Python/Java

● Good understanding of data architecture patterns (data warehouse, data lake, streaming)

● 2+ years of hands-on experience in Cloud computing platforms (any one of AWS/Azure/GCP)

● Linux environment, SQL & NoSQL, and Shell scripting

● Clear understanding of Git/version control

● Knowledge of deploying ML models is a plus

● Knowledge of feature stores is a plus

Job Type

Contract Base


Data Scientists

Must have Skills

  • Python
  • Scala
  • SQL
  • NoSQL
  • Shell Scripting
  • Data Warehousing
  • Apache-Kafka
  • Data Engineer

21 - 24 USD/Hour (Hourly rate)

Longterm (Duration)

Fully Remote


Aayush A