Description

You will own the lifecycle of Kafka clusters, ensuring high availability, optimal performance, and security for real-time data streaming.

Responsibilities

• Install, configure, and maintain Kafka clusters with high availability and disaster recovery strategies.
• Monitor cluster performance, identify bottlenecks, and fine-tune configurations for optimal throughput and latency.
• Implement security protocols, including access control, authentication, and encryption.
• Set up monitoring and alerting systems to proactively resolve connectivity and data issues.
• Automate routine management tasks and create scripts to streamline cluster operations and capacity planning.

Required Skills

• 5+ years of experience with Apache Kafka administration and cluster management.
• Strong knowledge of Kafka architecture, including high availability and disaster recovery patterns.
• Experience with performance optimization, tuning for throughput, and latency reduction.
• Proficiency in implementing security protocols, including access control, authentication, and encryption.
• Ability to troubleshoot complex issues within the Kafka ecosystem, including connectivity and data problems.
• Experience setting up monitoring and alerting systems for proactive issue resolution.
• Skills in automation and scripting to streamline cluster management tasks.

Preferred Skills

• Experience with capacity planning and assessing resource needs for effective scaling.
• Ability to collaborate with development teams to integrate Kafka with other systems and applications.

Key Skills

Education

Any Gradute