Description
You will design and maintain scalable data platforms on Google Cloud Platform, focusing on architecture, performance, and governance.
Responsibilities
- Architect Medallion data models and optimize BigQuery performance using partitioning and clustering.
- Build and manage Cloud Dataflow pipelines for efficient data processing.
- Design orchestration frameworks using Cloud Composer (Airflow) and implement CI/CD practices with Git.
- Ensure security and governance by configuring GCP IAM and securing data architecture.
- Maintain cost-efficient and scalable cloud data solutions.
Required Skills
- 5+ years of experience in data engineering roles.
- Deep expertise in BigQuery architecture and performance optimization.
- Strong programming skills in Python and PySpark.
- Advanced SQL proficiency and data modeling capabilities.
- Experience with Google Cloud Storage (GCS) and Cloud Dataflow.
- Hands-on experience with Cloud Composer (Airflow) for orchestration.
- Knowledge of GCP IAM, security architecture, and data governance.