Job Summary

The team member will be part of a Kafka platform development team responsible for architecture administration and operations for Kafka clusters across all nonproduction and production environments The role involves best design solution ensuring system reliability optimizing performance automating regular tasks providing guidance to team for onboarding applications helping team for upskillcrosstraining and troubleshooting issues to maintain seamless Kafka operations

Key Responsibilities

Architect Manage and maintain Kafka clusters in nonprod and prod environments

Responsible for high level discussions with customers

Responsible for proposing best solutions as per industry standards

Responsible for doing POCs and documenting the exercise

Getting involved with team members to solve their technical problems

Handling high priority discussions and drive the meetings with vendor if required

Skills and Abilities

Strong knowledge of Kafka architecture

Handson experience with Kafka cluster setup using ZookeeperKraft

Proficiency in working with Kafka connectors and ksqlDB

Experience with Kubernetes for Kafka deployment and management

Ability to create Docker images and work with containerized environments

Proficiency in writing YAML configurations

Strong troubleshooting and debugging skills

Experience with monitoring tools like Datadog

Experience in creating monitorss from inbuilt JMX metrics for Kafka server consumer metrics producer metrics etc

Familiarity with GitLab CICD pipelines

Proficiency in Terraform for infrastructure automation

Strong understanding of AWS cloud services

Helping team members to troubleshooting best practices etc

Experience with IT service management processes incident change and problem management

Experience

10 years of experience managing Kafka clusters in production environments

Experience setting up and maintaining Kafka on Kubernetes

Handson experience with AWS cloud infrastructure

Experience with CICD pipelines infrastructure automation and monitoring tools

Certifications confluent AWS

Experience in user onboarding through selfservice

Familiarity with CFK operator or any other operator for Apache Kafkaconfluent Kafka on EKS

Good and proactive in terms of offering solutions to customers

Skills

Mandatory Skills : Integration Architecture, Kafka