Description

Lead the development and management of real-time streaming applications and cloud-native data architectures.

Responsibilities

  • Build and maintain real-time streaming applications using Flink and Spark.
  • Design and implement cloud-native data systems and infrastructure.
  • Manage deployment pipelines using Argo CD and Argo Workflows.
  • Monitor system health and performance using Prometheus and Aether.
  • Support AI/ML workflows and data processing pipelines.

Required Skills

  • 8+ years of experience in data engineering.
  • Expertise in Java.
  • Hands-on experience with Flink, Spark, and Kafka or Pulsar.
  • Proficiency with Kubernetes and DevOps tools.
  • Experience with Argo CD and Argo Workflows.
  • Knowledge of Prometheus and Aether.
  • Experience with Postgres, Druid, Oracle, and Hadoop.

Preferred Skills

  • Familiarity with AI/ML tools including Kubeflow and JupyterHub.

Key Skills
Education

Any Graduate

Back To Jobs