You will drive the migration of legacy data warehouses to Google Cloud platforms for a major telecommunications provider.
Responsibilities
- Architect and develop complex ETL pipelines within Google Cloud data environments.
- Design data pipelines for underlying data warehouses and specialized data marts.
- Collaborate with Data Product Managers and Architects to deliver end-to-end data solutions.
- Maintain detailed documentation to support data quality, governance, and deployment activities.
- Support QA, UAT testing, and deployment to higher environments while meeting SLAs.
Required Skills
- 8+ years of data engineering experience developing large-scale pipelines in complex environments.
- Expert-level SQL skills with the ability to build complex transformations in BigQuery.
- Strong Python programming skills for automating jobs and pipeline development.
- Hands-on experience with Google Cloud technologies including BigQuery, GCS, Dataflow, Pub/Sub, Data Fusion, and Cloud Functions.
- Experience with Airflow for building and debugging complex job orchestration.
- Ability to optimize queries within BigQuery environments.
- Exposure to Teradata and the ability to interpret complex Teradata BTEQ scripts.
- Proficiency with Git/GitHub for version control.
- Familiarity with Data Modeling, Data Warehousing methodologies, and Agile/Scrum practices.
Preferred Skills
- Experience with GCP Data Proc and Bash scripting.
- Ability to lead teams in an onsite/offshore delivery model.