Description

You will build and maintain scalable data infrastructure on GCP, integrating Snowflake and BigQuery.

This role is on-site.

Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows using GCP services like BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Manage secure, efficient data integrations between Snowflake and BigQuery.
• Write, test, and maintain Python code for ETL, analytics, and automation tasks.
• Implement infrastructure-as-code using Pulumi for managing cloud resources in GCP.
• Debug complex issues within data pipelines and cloud environments.

Required Skills

• 10+ years of experience in data engineering.
• Strong hands-on experience with GCP core services: BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Proficiency in data engineering development using Python.
• Deep familiarity with Snowflake, including data modeling and query optimization.
• Proven experience using Git for source code management and collaboration.
• Demonstrated ability using Pulumi or similar IaC tools for cloud infrastructure deployment.
• Practical understanding of cleanroom concepts related to cloud data warehousing and privacy.

Preferred Skills

• Effective communication and documentation skills.

Key Skills

Education

Any Graduate