Description

Build and optimise scalable data analytics pipelines on Google Cloud Platform using Spark, Scala, and Python.

This role is on-site.

Responsibilities

• Design and maintain scalable data processing workflows using GCP BigQuery and Scala.
• Write and optimise complex ANSI SQL queries for data extraction, transformation, and validation.
• Implement automation scripts to improve pipeline efficiency and reliability.
• Monitor and optimise the performance and cost of data processing jobs on GCP.
• Mentor junior team members and participate in code reviews.

Required Skills

• 5+ years of experience in data engineering.
• Strong proficiency in GCP BigQuery and ANSI-SQL.
• Hands-on experience with Apache Spark and Scala.
• Proficiency in Python for data processing and automation.
• Experience with cloud-based data analytics workflows.

Preferred Skills

• AWS knowledge is an advantage.

Key Skills

Education

Any Graduate