← Back to jobs

Prophecy Technologies Logo
Kafka Engineer

Prophecy Technologies

 

Irvine, CA, USA

Posted On: Just posted
Experience: 5+ years
Availability: Remote
Openings: 1
Category: Kafka Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Role Overview:

This role is for a dedicated Kafka Engineer responsible for the comprehensive management of Confluent and AWS MSK Kafka clusters. The position involves the installation, configuration, maintenance, and optimization of large-scale, multi-node Kafka environments, encompassing both on-premise and cloud deployments. A key focus is on ensuring the security, performance, and high availability of Kafka infrastructure, alongside providing essential support to development teams and driving automation initiatives for Kafka deployments.

Key Responsibilities:

  • Install, configure, and maintain Confluent and AWS MSK Kafka clusters.
  • Manage large-scale, multi-node Kafka cluster environments across on-premise and cloud platforms.
  • Troubleshoot and resolve issues pertaining to Kafka brokers, topics, and data flow.
  • Optimize Kafka configurations to enhance performance, scalability, and fault tolerance.
  • Plan and execute Kafka version upgrades and apply necessary patches.
  • Develop and maintain disaster recovery plans and comprehensive documentation for Kafka environments.
  • Implement and manage robust security protocols for Kafka clusters.
  • Monitor Kafka clusters diligently to ensure optimal performance and continuous availability.
  • Collect and maintain critical performance metrics for analysis and reporting.
  • Fine-tune Kafka configurations based on collected performance data to achieve efficiency.
  • Provide expert guidance and support to developers utilizing Kafka for their applications.
  • Automate Kafka Cluster installations and the deployment of topics, ACLs, and connectors using tools such as Ansible, Terraform, and GitOps.
  • Develop and maintain automation scripts and processes for Kafka infrastructure.

Required Skills:

  • Strong understanding of Kafka architecture, core concepts, and best practices.
  • Proven experience in administering the Confluent platform, including Brokers, Zookeepers, Schema Registry, Restproxy, Ksql, Connectors, Control Center, Topics, and ACLs.
  • Proficiency with automation tools like Ansible, Terraform, and GitOps for infrastructure management.

Qualifications:

  • Proven experience in Kafka administration is required

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs