Description

Architect and build enterprise-scale data platforms and services within a GCP environment.

Responsibilities

• Design and develop end-to-end data platforms, including batch and real-time streaming infrastructure.
• Implement metadata management, covering data catalogues, lineage, quality, and observability.
• Build semantic layers and manage data ingestion, migration, and transformation pipelines.
• Apply DataOps principles and test automation to data workflows.
• Ensure data governance, security (IAM, KMS, DLP), and robust data modeling.

Required Skills

• 10-15+ years of experience in modern cloud data engineering and software engineering.
• Extensive experience building data platforms on GCP, including BigQuery, Dataflow (Apache Beam), and Cloud Composer (Airflow).
• Advanced proficiency in SQL and Python.
• Hands-on experience with GCS, GKE, Cloud Functions, Cloud Run, and Dataproc.
• Strong knowledge of PubSub and data lakehouse architectures.
• Experience with Kubernetes, Docker, and microservices architectures.
• Proficiency in Dataform or dbt for transformation.
• Experience with CI/CD using GitHub and Cloud Build, plus Terraform.
• Competency in observability tooling such as Grafana or Datadog.

Preferred Skills

• Java programming experience.
• Data visualization experience with Looker, PowerBI, or SAP BOBJ.

Key Skills

Education

Any Graduate