Description

You will build, ingest, and transform large datasets to deliver curated data products on Google Cloud Platform.

Responsibilities

• Develop analytical data products using both streaming and batch ingestion patterns.
• Automate all parts of the data pipeline to minimize manual labor in development and production.
• Collaborate with architects to evaluate and operationalize pipelines for data ingestion, curation, and consumption.
• Translate business problems into technical data requirements in collaboration with product management.
• Work within an agile team using paired programming to deliver high-quality data solutions.

Required Skills

• 5+ years of SQL development experience.
• 5+ years of analytics or data product development experience.
• 3+ years of Google Cloud experience with solutions implemented at production scale.
• Proficiency with GCP native services including BigQuery, Google Cloud Storage, PubSub, Dataflow, Dataproc, and Cloud Build.
• 2+ years of professional development experience in Python or Java.
• Experience with Airflow for pipeline scheduling and orchestration.
• Experience using Terraform for Infrastructure as Code.
• Experience migrating Teradata to GCP.
• Bachelor's degree in Computer Science or a related scientific field.

Preferred Skills

• Experience with DBT, Dataform, or Data Catalog tools like DataPlex.
• Experience with CI/CD ecosystems including Tekton, Git, or Jenkins.
• GCP Professional Data Engineer certification.

Key Skills

Education

Bachelor's degree