Description

You will build and manage large-scale stream and batch processing systems. You will design scalable solutions, lead technical implementation, and maintain cloud-based messaging and stream processing infrastructure.

Responsibilities

• Architect and design scalable solutions for stream and batch processing at scale.
• Implement and maintain messaging and stream processing systems on public cloud environments.
• Apply DevOps principles to manage infrastructure and deployment pipelines using CI/CD and IaC.
• Lead engineering teams technically on specific projects or components.
• Solve complex data processing problems by exploring new technical domains.

Required Skills

• 4+ years of professional experience with stream or batch processing systems at scale.
• Proficiency in Java and Python.
• Hands-on experience with messaging or stream processing tools such as Pub/Sub, Kafka, Kinesis, Dataflow, or Flink.
• Experience with batch processing systems including Hadoop, Pig, Hive, or Spark.
• Knowledge of containerization technologies like Docker and Kubernetes.
• Experience with DevOps tools including CI/CD and IaC/Terraform.
• Strong problem-solving and critical thinking capabilities.

Preferred Skills

• Experience with GCP and GCP managed services.
• Experience with Dataproc.

Key Skills

Education

ANY GRADUATE