Description

Lead the design and implementation of data monitoring pipelines to ensure data quality and reliability.

This role is on-site.

Responsibilities

• Design and implement data monitoring pipelines to proactively identify and resolve data quality issues.
• Collaborate with stakeholders to define requirements and develop metrics for data pipeline quality.
• Negotiate data quality SLAs on behalf of downstream data product owners.
• Serve as a technical leader for the development of new data platform capabilities.

Required Skills

• 8+ years of coding experience in Python, Java, or an equivalent language.
• 5+ years of experience with Apache Spark.
• Proficiency with Apache Airflow.
• Expertise in cloud technologies, specifically GCP and/or AWS.
• Deep understanding of Distributed Systems and Effective Data Management.
• Experience with CI/CD tools such as Jenkins.
• Strong proficiency in SQL.

Preferred Skills

• Bachelor’s Degree in Computer Science, Engineering, or a related STEM field.

Key Skills

Education

ANY GRADUATE