Own the design, architecture, implementation, and ongoing support of Kafka clusters for an Event Streaming Architecture Pilot project.
Responsibilities
Manage large-scale, multi-node Kafka cluster environments including builds, capacity planning, and performance tuning.
Perform high-level operational maintenance, installations, upgrades, and monitoring for Kafka clusters.
Implement Kafka security protocols including authentication, authorization, and encryption.
Handle data access, data retention, and archiving requirements.
Resolve performance bottlenecks and manage cluster capacity.
Required Skills
6+ years of experience in application development or system administration roles.
Expertise in installing and maintaining Confluent Platform components: Apache Kafka, Confluent Control Center, Schema Registry, Replicator, and Security Plugins.
Extensive experience administering Event Driven Architecture components including Kafka Brokers, ZooKeeper, and Connect clusters.
Proven experience setting up clusters on bare-metal and Cloud VMs.
6+ years of experience with Cloud Operations (On-Premise, Internal, or External Cloud).
2+ years of experience with scripting technologies such as Ansible, Jenkins, or Kubernetes/Docker orchestration.
Strong knowledge of Apache Kafka, Data Integration, Data Retention, and Capacity Planning.
Ability to browse events across federated brokers.
Experience with system analysis and software application programming.
Preferred Skills
Working knowledge of Apache Spark, Talend, or messaging systems like AMQ.
Experience with OpenShift cluster administration.
Knowledge of Java-based applications, Docker, and Kubernetes.