Description

Lead the development and management of real-time streaming applications and cloud-native data architectures.

Responsibilities

• Build and maintain real-time streaming applications using Flink and Spark.
• Design and implement cloud-native data systems and infrastructure.
• Manage deployment pipelines using Argo CD and Argo Workflows.
• Monitor system health and performance using Prometheus and Aether.
• Support AI/ML workflows and data processing pipelines.

Required Skills

• 8+ years of experience in data engineering.
• Expertise in Java.
• Hands-on experience with Flink, Spark, and Kafka or Pulsar.
• Proficiency with Kubernetes and DevOps tools.
• Experience with Argo CD and Argo Workflows.
• Knowledge of Prometheus and Aether.
• Experience with Postgres, Druid, Oracle, and Hadoop.

Preferred Skills

• Familiarity with AI/ML tools including Kubeflow and JupyterHub.

Key Skills

Education

Any Graduate