Description

You will build foundational datasets from clickscream and quality of service telemetry data, enabling engineering and analytical teams to drive business decisions for the streaming service.

Responsibilities

• Maintain, update, and expand existing data pipelines using Python and Spark while adhering to uptime SLAs.
• Architect, design, and code shared libraries in Scala and Python to abstract complex business logic across pipelines.
• Collaborate with product managers, architects, and engineers to ensure the success of Product Performance Data initiatives.
• Develop and document internal and external standards for pipeline configurations, naming conventions, and partitioning strategies.
• Ensure high operational efficiency and data quality to meet SLAs for internal and external partners.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert level proficiency in SQL.
• Extensive experience with Scala.
• Strong command of Python and Spark.
• Experience with Airflow, Databricks, Delta Lake, and Snowflake.
• Proven ability to articulate complex technical information clearly to business stakeholders.
• Demonstrated self-starter capability, capable of driving outcomes independently.
• Authorization to work in the US without sponsorship now or in the future.

Key Skills

Education

Any Graduate