Description

Lead the development and management of real-time streaming applications and cloud-native data architectures.

Responsibilities

• Design and implement real-time streaming applications using Flink or Spark.
• Manage data workflows and deployments using Argo CD and Argo Workflow.
• Build and maintain cloud-native data pipelines and infrastructure.
• Oversee data processing across distributed systems like Hadoop and Kafka or Pulsar.
• Integrate AI/ML workflows using tools such as Kubeflow and JupyterHub.

Required Skills

• 8+ years of experience in data engineering.
• Proficiency in Java.
• Hands-on experience with Kubernetes.
• Deep expertise in Flink or Spark.
• Experience with Argo CD and Argo Workflow.
• Working knowledge of Kafka or Pulsar.
• Experience with Prometheus and Aether.
• Proficiency with Postgres, Druid, and Oracle databases.
• Experience with Hadoop and AI/ML frameworks including Kubeflow and JupyterHub.

Preferred Skills

• Experience with cloud-native design and DevOps tooling.

Key Skills

Education

Any Graduate