Description

You will build and maintain critical data infrastructure for Engineering, Data Science, and Analytics teams.

This role is hybrid.

Responsibilities

• Maintain, update, and expand data pipelines using Python and Spark to meet uptime SLAs.
• Design and code shared libraries in Scala and Python to abstract complex business logic.
• Collaborate with product managers and architects to deliver Product Performance Data.
• Develop and document internal and external standards for pipeline configurations and partitioning.
• Ensure data quality and operational efficiency across all data workflows.

Required Skills

• 5+ years of experience developing large-scale data pipelines.
• Strong fundamental Python programming skills.
• Proficiency with Scala for library development.
• Experience with Airflow, Spark, Databricks, Delta Lake, and Snowflake.
• Strong SQL skills with ability to create complex queries.
• Familiarity with AWS resources, specifically S3.
• Strong algorithmic problem-solving expertise.
• Ability to participate in agile/scrum ceremonies.

Key Skills

Education

Any Graduate