Description

You will build and maintain critical data infrastructure.

Responsibilities

• Maintain, update, and expand existing data pipelines using Python and Spark while meeting uptime SLAs.
• Design and code shared libraries in Scala and Python to abstract complex business logic across pipelines.
• Collaborate with product managers and architects to deliver Product Performance Data and support business stakeholders.
• Develop and document internal and external standards for pipeline configurations and partitioning.
• Ensure data quality and operational efficiency to meet SLAs for Engineering, Data Science, and Analytics teams.

Required Skills

• 5+ years of experience developing large data pipelines.
• Strong fundamental Python programming skills.
• Proficiency with Scala.
• Experience with Airflow, Spark, Databricks, Delta Lake, Snowflake.
• Strong SQL skills and complex query creation ability.
• Familiarity with AWS or other cloud provider resources (S3).
• Strong algorithmic problem-solving expertise.
• Ability to participate in agile/scrum ceremonies.

Key Skills

Education

Any Graduate