Description

You will design and implement data engineering frameworks to scale pipeline development and deployment across the organization.

This role is hybrid.

Responsibilities

• Build complex batch and streaming pipelines to ingest data from upstream cloud systems.
• Enable new GCP services and build self-service capabilities to enhance data platform functionality.
• Mentor junior engineers within the Data Platform team and the broader organization.
• Set engineering standards and best practices for the data and analytics organization.

Required Skills

• 7+ years of experience in data engineering, data architecture, or a related field.
• 3+ years of experience working in a GCP big data environment.
• Proficiency in Python development and professional experience with SQL.
• Experience building complex data pipelines using two or more of: BigQuery, Dataflow, Dataproc, Pub/Sub, or Cloud Functions.
• Experience with Airflow or Cloud Composer.
• Strong understanding of data modeling, data warehousing, and data integration.

Preferred Skills

• GCP Professional Data Engineer or Professional Cloud Architect certification.
• Experience with dbt, Java, or scaling Airflow.
• DevOps/CI/CD experience using Jenkins and GitHub, and IaC experience using Terraform for GCP infrastructure.

Key Skills

Education

Any Graduate