Description

You will manage, enhance, and scale Apache Kafka and Confluent Platform infrastructure on AWS.

This role is hybrid.

Responsibilities

• Review current Kafka implementations and recommend architectural improvements.
• Collaborate with engineering and product teams to define scalable streaming patterns for new use cases.
• Implement and maintain Kafka producers, consumers, Connectors, and Kafka Streams applications.
• Enforce governance on topic design, schema evolution, partitioning, and data retention policies.
• Monitor, troubleshoot, and tune Kafka clusters using Confluent Control Center, Prometheus, and Grafana.

Required Skills

• 10+ years of professional software engineering experience.
• Expertise with Apache Kafka and Confluent Kafka ecosystem.
• Proficiency in Kafka client development using Python or Java.
• Experience deploying and managing Kafka on AWS (MSK or self-managed EC2).
• Solid understanding of Kubernetes, specifically EKS, for microservices integration.
• Hands-on experience with Kafka Connect, Kafka Streams, and schema management.
• Infrastructure automation experience using Terraform.
• Familiarity with monitoring stacks like Prometheus and Grafana.

Preferred Skills

• Experience with Apache Flink for stream processing.
• Knowledge of TLS configuration and security best practices in distributed systems.

Key Skills

Education

Bachelor's degree