Description

You will build and manage Kafka infrastructure using the Confluent Platform.

Responsibilities

• Design, build, and manage Kafka clusters using the Confluent Platform.
• Develop and deploy Kafka producers, consumers, connectors, and streaming applications.
• Monitor, tune, and troubleshoot Kafka clusters to ensure high availability and optimal performance.
• Collaborate with developers and data engineers to integrate Kafka with upstream and downstream systems.
• Develop automation scripts for Kafka cluster deployment and configuration using Ansible, Terraform, or custom scripts.

Required Skills

• Strong hands-on experience with Apache Kafka and Confluent Platform in production environments.
• In-depth understanding of Kafka internals, including partitions, brokers, replication, consumer groups, and retention policies.
• Proficiency in Kafka Connect, Kafka Streams, and ksqlDB for building real-time data pipelines.
• Good working knowledge of Azure Cloud Services for Kafka integration.
• Familiarity with Linux/Unix environments for managing Kafka services.
• Experience using automation tools such as Ansible, Terraform, or Bash/Python scripts.
• Strong understanding of Kafka security, including RBAC, SSL encryption, SASL authentication, and ACL management.

Key Skills

Education

Any Graduate