Description

Design and maintain scalable Big Data pipelines on Google Cloud Platform to ensure reliable batch and real-time data processing for analytics and reporting.

This role is on-site.

Responsibilities

• Build and optimize ETL/ELT workflows to ingest data from structured and unstructured sources.
• Develop high-performance SQL queries and efficient data models to support business intelligence.
• Architect data solutions using GCP services including BigQuery, Dataproc, Dataflow, and Composer.
• Monitor production systems, troubleshoot distributed environment issues, and resolve incidents.
• Automate operational processes and enforce coding standards, version control, and documentation.

Required Skills

• 10+ years of experience in data engineering roles.
• Strong proficiency with PySpark and Spark SQL for batch and streaming processing.
• Hands-on experience with Google Cloud Platform, specifically BigQuery, Dataproc, and Dataflow.
• Expertise in writing complex SQL queries and designing data models.
• Experience with Google Cloud Composer for workflow orchestration.
• Familiarity with Pub/Sub and Cloud Storage services.
• Practical experience working within Agile delivery frameworks.

Preferred Skills

• Experience collaborating with cross-functional product and business teams.
• Background in driving analytics initiatives to deliver actionable insights.

Key Skills

Education

Any Graduate