Description

You will build and maintain data engineering pipelines and data warehouse systems within a GCP environment. You own the full lifecycle of batch and real-time Big Data deployments, ensuring robust ETL processes and complex SQL query execution. Your work involves deploying Google Cloud infrastructure using Terraform and leveraging a suite of GCP services for data processing.

Responsibilities

• Build and manage batch and real-time Big Data deployments on GCP.
• Develop data engineering pipelines and data warehouse systems.
• Write complex SQL queries to handle data processing requirements.
• Deploy Google Cloud services using Terraform.

Required Skills

• 5+ years of experience with GCP.
• 3+ years of experience with Java or Python.
• 2+ years of experience building data engineering pipelines and data warehouse systems.
• 2+ years of experience with Hive and Oozie Scheduler.
• 1+ year of experience deploying Google Cloud services using Terraform.
• Proficiency in BigQuery, Bigtable, Google Cloud Storage, Pub/Sub, Data Fusion, Dataflow, and Dataproc.
• Strong understanding of ETL principles.
• Advanced SQL skills for complex querying.
• Bachelor's or Master's Degree in a relevant field.

Key Skills

Education

Bachelor's or Master's Degree