Description
Manage and enhance Apache Kafka and Confluent Platform environments on AWS.
This role is on-site.
Responsibilities
- Implement and maintain Kafka producers, consumers, Connectors, and Streams applications.
- Enforce governance for topic design, schema evolution, partitioning, and data retention.
- Monitor, troubleshoot, and tune clusters using Confluent Control Center, Prometheus, and Grafana.
- Automate infrastructure deployment and scaling using Kubernetes and Terraform.
Required Skills
- 8+ years in platform engineering with 5+ years of hands-on Apache Kafka and Confluent Kafka experience.
- Proficiency in Kafka client development using Java or Python.
- Expertise with Confluent Platform components: Brokers, Schema Registry, Control Center, and ksqlDB.
- Experience deploying Kafka on AWS via MSK or self-managed EC2 setups.
- Solid understanding of Kubernetes (EKS) for microservices integration.
- Hands-on experience with Kafka Connect, Kafka Streams, and schema management.
- Infrastructure automation using Terraform and Helm.
- Experience with monitoring stacks including Prometheus, Grafana, and ELK.
Preferred Skills
- Experience in FinTech or regulated industries.
- Knowledge of security best practices (TLS, SASL, OAuth, RBAC, encryption at rest).
- Exposure to Apache Flink or Spark Streaming.
Any Graduate degree.