Description

• Data pipeline development: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Java.
• Kafka application development: Develop and implement Kafka producer and consumer applications, including microservices.
• Integration: Integrate Kafka with various existing systems, databases, and data sources.
• Performance optimization: Monitor and troubleshoot Kafka cluster performance, topics, and brokers for efficiency and scalability.
• Maintenance and support: Support and upgrade existing Kafka implementations and troubleshoot issues.
• Security and compliance: Implement security measures to protect data streams and meet compliance standards.

To be skilled and experienced in:

• Core Java: Strong proficiency in Java, including concepts like multi-threading, concurrency, and collections.
• Apache Kafka: Deep knowledge of Kafka architecture, features, and components like Kafka Streams, ZooKeeper, and Schema Registry.
• Messaging and streaming: Experience with messaging and stream processing on Kafka.
• Microservices: Experience with microservices architecture, as many Kafka applications are built as microservices.
• Databases: Experience with databases and data warehousing technologies (e.g., PostgreSQL, Oracle) is often required or preferred
• Frameworks: Experience with frameworks like Spring (Spring Boot, Spring JPA) and ORM frameworks.
• Big data technologies: Familiarity with big data technologies like Spark, Hadoop, or Snowflake

Key Skills

Education

Bachelor’s degree