Description

You will architect and manage Kafka infrastructure solutions in a cloud environment.

Responsibilities

• Design, install, and administer Kafka clusters, ensuring HA and SLA compliance on OpenShift or Kubernetes.
• Optimize data pipelines and replication strategies, focusing on performance tuning across the Kafka ecosystem.
• Develop and operationalize new Kafka Connectors for specific use cases.
• Apply microservice design principles when integrating with distributed systems and managing service-to-service communication.
• Manage Kafka Connect, kstreams, and ksql effectively for various data processing needs.

Required Skills

• 10+ years of experience, any graduate degree.
• Expert-level, hands-on production experience with Confluent Kafka, including capacity planning and internals.
• Expert knowledge of Kafka cluster and application security.
• Deep understanding of Event Driven Architecture (EDA) and distributed systems patterns.
• Expert experience with Kafka Connect, KSstreams, and KSQL.
• Hands-on experience scaling Kafka infrastructure (Broker, Connect, ZooKeeper, Schema Registry).
• Proficiency in Java and SpringBoot, alongside Python.
• Solid experience with data serialization using Avro and JSON.
• Experience with AWS services including ECS, EKS, and S3.

Key Skills

Education

Any Graduate