Description

You will design and build scalable data pipelines on Google Cloud Platform to process large volumes of data.

This role is hybrid.

Responsibilities

• Develop and maintain ETL workflows using Dataflow and Dataproc.
• Write optimized SQL queries in BigQuery for data warehousing and analytics.
• Build data solutions using Python and PySpark APIs.
• Collaborate with cross-functional teams to validate data integrity and execute projects.
• Monitor and manage compliance requirements as per AEMP70 policy.

Required Skills

• 5+ years of hands-on experience with Google Cloud Platform (GCP).
• Strong proficiency in Python with object-oriented programming principles.
• Extensive experience with PySpark for processing huge data volumes.
• Deep understanding of ETL concepts and data warehousing principles.
• Advanced SQL skills with ability to write and optimize complex queries.
• Experience building data pipelines for high-volume data systems.

Preferred Skills

• Experience with database architecture and data flow design.
• Background in policy and procedure evaluation.

Key Skills

Education

Any Graduate