Description

You build and maintain scalable batch and real-time data pipelines.

This role is on-site.

Responsibilities

• Design and maintain scalable data pipelines using Apache Spark, SQL, and Hive.
• Develop ELT/ETL workflows to ingest and transform enterprise data into BigQuery.
• Implement cloud-native data architectures on GCP, integrating transactional and analytical platforms.
• Optimize Spark jobs, SQL queries, and BigQuery workloads for performance and latency.
• Manage workflow orchestration using Apache Airflow (Cloud Composer) for ingestion and validation.

Required Skills

• 5+ years of experience in data engineering or big data development.
• Strong expertise with Google Cloud Platform (GCP).
• Deep experience with Apache Spark and BigQuery.
• Proficiency in SQL and Hive.
• Experience building data ingestion frameworks using GCP services (Cloud Dataflow, Pub/Sub, GCS).
• Experience designing dimensional data models (fact and dimension tables).
• Knowledge of data governance, lineage, and quality checks.

Preferred Skills

• Bachelor's or Master's degree in Computer Science, Data Engineering, or Information Systems.

Key Skills

Education

Bachelor's or Master's degrees