Description

responsible for installing| configuring| maintaining| and monitoring Apache Kafka clusters to ensure high availability| security| and optimal performance.
They manage topics| partitions| and replication| troubleshoot issues| implement security protocols (SSLTLS| SASL| ACLs)| and automate tasks using tools like Ansible or Terraform.
TechfetchTechfetch 4 Key Roles and Responsibilities Cluster Management Installing| configuring| and upgrading Kafka brokers| ZookeeperK Raft| Connect| and Schema Registry.
Performance Tuning Monitoring Monitoring cluster health| broker performance| consumer lag| and producer latency using tools like Prometheus and Grafana to ensure high throughput.
Topic Partition Management Managing topic configuration| partitioning strategies| replication factors| and data retention policies.
Security Access Control Implementing security measures such as SSLTLS encryption| Kerberos authentication| and ACLs (Access Control Lists) to secure data.
Troubleshooting Support Providing 3rd-level support to resolve broker| producer| or consumer issues and performing root cause analysis (RCA).
Disaster Recovery High Availability Designing and managing replication strategies across regions for disaster recovery and ensuring broker redundancy.
Automation Developing scripts to automate routine tasks| such as provisioning and monitoring| using Ansible| Puppet| or Kubernetes.Collaboration Working with developers to design data pipelines| optimize producerconsumer configurations| and onboard new applications.
TechfetchTechfetch 9 Required Skills In-depth knowledge of Apache KafkaConfluent Kafka.
Strong Linux system administration skills.
Experience with monitoring tools (Prometheus| Grafana| JMX).
Scripting proficiency in Python| Bash| or Java.
Experience with containerization tools (Docker| KubernetesOpenShift)

Key Skills

Education

Bachelor's degree