Description

Design and manage data pipelines within the Google Cloud ecosystem.

Responsibilities

• Build and manage data ingestion processes into BigQuery.
• Develop and maintain data workflows using Cloud Composer and Google Dataform.
• Orchestrate messaging and event-driven architectures using Google Pub/Sub.
• Manage data storage and retrieval using Google Cloud Storage.
• Maintain code quality and version control through GitHub.

Required Skills

• 6+ years of data engineering experience.
• Expertise in BigQuery and advanced SQL.
• Hands-on experience with Google Pub/Sub.
• Proficiency with Google Dataform.
• Experience with Cloud Composer.
• Practical knowledge of Google Cloud Storage.
• Version control using GitHub.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Cloud Data Fusion.
• Connectivity experience with SQL Server, DB2, or Oracle.
• Experience calling RESTful APIs and SOAP Web Services.

Key Skills

Education

Bachelor's degree