You will own the migration and operation of data pipelines within Google Cloud Platform.
Responsibilities
- Lead and execute migration of data and ETL workflows from Teradata to GCP services (BigQuery, Cloud Storage, Dataflow, Dataproc, Composer).
- Analyze and map existing Teradata workloads to suitable GCP equivalents.
- Rewrite SQL logic, scripts, and procedures into GCP-compliant formats.
- Develop automated workflows for data movement and transformation using GCP-native tools or custom Python scripts.
- Optimize data storage, query performance, and costs within the cloud environment.
Required Skills
- 10+ years of experience in Data Engineering, with 2+ years specifically in GCP.
- Strong hands-on experience with Teradata data warehousing and complex SQL.
- Expertise in GCP services including BigQuery, Dataflow, Cloud Storage, Pub/Sub, Composer, and Dataproc.
- Proficiency in ETL/ELT pipeline development using custom scripting in Python or Java.
- Experience refactoring and translating legacy logic from Teradata to GCP.
- Familiarity with Big Data principles.
- Experience with Git and CI/CD practices in a cloud data environment.