Description

You own the administration, security, and scaling of high-availability Kafka clusters across on-prem and cloud environments. You minimize manual work by implementing Infrastructure-as-Code and specializing in deploying Kafka on Kubernetes.

Responsibilities

• Automate Kafka installation, broker configuration, upgrades, and patching using Ansible playbooks and Python scripts.
• Deploy and manage Confluent Platform using Confluent for Kubernetes (CFK) on OpenShift or Kubernetes, including Kafka Raft mode.
• Implement Terraform for infrastructure provisioning and GitOps workflows (ArgoCD/Jenkins) for continuous deployment.
• Utilize Prometheus, Grafana, and Confluent Control Center to monitor broker health, consumer lag, and producer latency.
• Configure and automate Kafka Connectors (S3, JDBC, Snowflake) and manage data governance via Confluent Schema Registry.

Required Skills

• 10+ years of experience in Apache Kafka and Confluent Kafka administration.
• Expertise in automation tools: Ansible, Terraform, GitOps, Shell scripting, and Python.
• Strong infrastructure skills with Kubernetes (specifically OpenShift) and Linux.
• Proficiency in monitoring tools including Prometheus, Grafana, and JMX.
• Deep knowledge of networking and security protocols: TLS, Kerberos, SASL, RBAC, and ACLs.
• Experience with disaster recovery, including Active-Passive clusters and ClusterLink for multi-region replication.
• Bachelor's degree in a relevant technical field.

Preferred Skills

• Experience managing Kafka Connectors for Snowflake and JDBC sources.
• Familiarity with Jenkins for CI/CD pipeline integration.

Key Skills

Education

Bachelor's degree