Description

You will build and maintain scalable data infrastructure on GCP.

Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows using GCP services like BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Design and manage secure, efficient data integrations between Snowflake and BigQuery.
• Write, test, and maintain Python code for ETL, analytics, and automation tasks.
• Implement infrastructure-as-code using Pulumi for managing cloud resources in GCP.
• Collaborate with cross-functional teams to deliver data solutions and ensure data integrity.

Required Skills

• 10+ years of experience in data engineering.
• Strong hands-on experience with GCP core services: BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Proficiency in data engineering development using Python.
• Deep familiarity with Snowflake, including data modeling and query optimization.
• Proven experience using Git for source code management and collaboration.
• Demonstrated ability using Pulumi or similar IaC tools for cloud infrastructure deployment.
• Practical understanding of cleanroom concepts related to cloud data warehousing and privacy.
• Solid skills in debugging complex issues within data pipelines and cloud environments.
• Effective communication and documentation skills.

Key Skills

Education

Any Graduate