Description

Design and maintain scalable data pipelines and warehousing solutions on Google Cloud Platform, integrating legacy MS SQL Server systems.

This role is remote.

Responsibilities

• Build and optimize ETL/ELT pipelines using GCP Dataflow, Python, and Cloud Composer.
• Develop and tune BigQuery datasets, including partitioning, clustering, and complex SQL queries.
• Maintain and optimize MS SQL Server objects such as stored procedures, views, and functions.
• Implement data quality, validation, and monitoring frameworks for end-to-end processing.
• Collaborate with stakeholders to define requirements and ensure data governance compliance.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python for data processing and automation.
• Hands-on experience with Google BigQuery and Cloud Storage.
• Experience developing pipelines with Google Cloud Dataflow (Apache Beam).
• Strong background in MS SQL Server performance tuning and database objects.
• Knowledge of GCP services: Pub/Sub, Composer/Airflow, IAM, and Monitoring.
• Understanding of ETL/ELT, Data Warehousing, and Data Modeling concepts.
• Experience with Git for source control and Agile/Scrum methodologies.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience migrating data from on-premises systems to GCP.

Key Skills

Education

Bachelor's degree