Description

Design and implement large-scale Kafka architectures to support high-throughput event-driven systems.

Responsibilities

• Design and implement large-scale Kafka architectures using Kafka Streams, Kafka Connect, and KSQL.
• Optimize Kafka cluster performance and troubleshoot issues under high-throughput conditions.
• Implement monitoring and observability for streaming infrastructure using Prometheus and Grafana.
• Deploy and manage Kafka services within containerized and cloud environments.
• Manage data integration scenarios and improve overall system efficiency.

Required Skills

• 5+ years of experience designing distributed systems and event-driven architectures.
• Deep expertise in Kafka, Kafka Streams, Kafka Connect, and KSQL.
• Proficiency in Java, Scala, Python, or Go.
• Experience with ZooKeeper, schema registries, Avro, or Protobuf.
• Hands-on experience with AWS MSK or Confluent Cloud.
• Experience using Docker and Kubernetes for containerized environments.
• Knowledge of performance tuning and monitoring with Prometheus and Grafana.
• Experience with CI/CD pipelines and Infrastructure as Code using Terraform or Ansible.
• Bachelor's degree in a relevant field.

Preferred Skills

• Certified Kafka Developer or Kafka Operations certification.
• Experience with real-time analytics, data warehousing, or big data environments.
• Familiarity with RabbitMQ, Pulsar, or ActiveMQ.

Key Skills

Education

Bachelor's degree