Description

Lead the development and maintenance of large-scale stream processing systems, defining scalable calculation logic for interactive and batch use cases.

Responsibilities

• Create and maintain Flink jobs in Java or Python, deploying them on OpenShift.
• Produce unit and system tests for all production code to ensure reliability.
• Participate in design discussions to improve existing frameworks and data pipelines.
• Collaborate with infrastructure and data teams to produce complex analysis across data sets.
• Troubleshoot and tune streaming applications for performance and resilience.

Required Skills

• 7+ years of programming experience.
• 3+ years developing stream processing systems.
• Proficiency in writing and reading Java and Python code.
• Hands-on experience with Flink real-time data streaming.
• Experience with the Flink Kubernetes Operator.
• Experience with Kafka, Cassandra, or MemSql.
• Knowledge of cloud-based technologies, specifically OpenShift.
• Familiarity with open source configuration management and development tools.

Preferred Skills

• Knowledge of design strategies for developing scalable, resilient, always-on data lakes.

Key Skills

Education

Any Graduate