Description

You will design, build, and manage Kafka clusters using the Confluent Platform.

This role is on-site.

Responsibilities

• Develop and deploy Kafka producers, consumers, connectors, and streaming applications.
• Implement Kafka Connect, Kafka Streams, and ksqlDB to build real-time data pipelines.
• Monitor, tune, and troubleshoot Kafka clusters to ensure high availability and optimal performance.
• Automate Kafka cluster deployment and configuration using Ansible, Terraform, or custom scripts.
• Implement data security, authentication, and authorization using Confluent RBAC and Kafka ACLs.

Required Skills

• 5+ years of experience with Apache Kafka and Confluent Platform in production environments.
• In-depth understanding of Kafka internals, including partitions, brokers, replication, and consumer groups.
• Hands-on experience deploying, configuring, and tuning Kafka clusters for high throughput and low latency.
• Proficiency in Kafka Connect, Kafka Streams, and ksqlDB.
• Working knowledge of Azure Cloud Services and integrating Kafka with cloud-native tools.
• Familiarity with Linux/Unix environments for managing Kafka services and scripts.
• Experience with automation tools such as Ansible, Terraform, or Bash/Python scripting.
• Strong understanding of Kafka security, including RBAC, SSL encryption, SASL, and ACL management.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Experience collaborating with developers and data engineers to integrate Kafka with upstream and downstream systems.

Key Skills

Education

Any Graduate