Big data Engineer | Online Jobs | Optimhire

Big data Engineer

Job Description

Job Description :

- Immediate Joiners Preferred
- Working experience and communicating with business stakeholders and architects
- Industry experience in developing relevant big data/ETL data warehouse experience building cloud native data pipelines
- Experience in Python, Pyspark, Scala, Java and SQL Strong Object and Functional programming experience in Python
- Experience worked with REST and SOAP based APIs to extract data for data pipelines
- Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, Sqoop, etc.
- Experience working in a public cloud environment, particularly AWS is mandatory
- Experience in working with Real time data streams and Kafka Platform.
- Working knowledge with workflow orchestration tools like Apache Airflow design and deploy dags.
- Hands on experience with performance and scalability tuning
- Professional experience in Agile/Scrum application development using JIRA

Job Type


Must have Skills

  • AWS
  • Hadoop
  • Big Data
  • PySpark

Up to 18 K/Year USD (Annual salary)

Longterm (Duration)

Fully Remote


Shivangi R

Payment Verified India