Description

You will own solution design at the team level, driving the convergence of existing data platforms into a unified architecture.

Responsibilities

• Lead high-level solution design for data engineering initiatives.
• Migrate current batch ETL workloads from Apache Spark on EMR to AWS Glue.
• Converge existing Spark and non-Spark jobs into the new Glue-based infrastructure.
• Establish robust ETL pipelines using Python and Apache Spark.

Required Skills

• 10+ years of experience in Data Engineering or Architecture.
• Expert-level proficiency in Python.
• Deep expertise in Apache Spark and EMR.
• Strong background in Batch ETL development.
• Experience with AWS Glue (preferred, but Spark EMR expertise is critical first).
• Ability to drive team-level technical strategy.

Key Skills

Education

ANY GRADUATE