Description

Design and maintain scalable data pipelines using Google Cloud Platform tools.

Responsibilities

• Build and optimize ETL processes using BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
• Write high-performance Python and SQL for data extraction, transformation, and loading.
• Implement complex data models in BigQuery using partitioning, clustering, and materialized views.
• Collaborate with cross-functional teams to define data requirements and deliver solutions.
• Monitor pipeline health, troubleshoot issues, and ensure data security and governance.

Required Skills

• 10+ years of hands-on experience with data management and consolidation.
• Strong expertise in Google BigQuery, Cloud Storage, Dataflow (Apache Beam), Pub/Sub, and Cloud Composer (Airflow).
• Proficiency in Python and SQL for data processing and automation.
• Experience designing scalable data pipelines and ETL architectures.
• Knowledge of data quality, governance, and security best practices.
• Ability to work in an Agile environment and manage task prioritization.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree