Description

You will build and maintain scalable data pipelines and infrastructure within a Google Cloud environment.

Responsibilities

• Develop and implement scalable data pipelines using BigQuery, Dataflow, Cloud Storage, and Composer.
• Design and implement bronze, silver, and gold layers using Medallion architecture.
• Optimize data storage solutions and processing workflows to ensure performance and reliability.
• Manage data quality, integrity, and security through validation, cleansing, and access control.
• Monitor data infrastructure health and troubleshoot complex data-related issues.

Required Skills

• 5+ years of experience in data engineering roles.
• Strong expertise in Google Cloud Platform (GCP) services including BigQuery, Dataflow, Cloud Storage, and Composer.
• Proficiency in Python and SQL.
• Deep understanding of Medallion architecture principles.
• Experience with ETL processes and data warehousing.
• Solid foundation in data modelling techniques.
• Knowledge of Apache Beam for Dataflow processing.
• Experience implementing data governance and security strategies.
• Ability to design for cloud architecture scalability and reliability.

Key Skills

Education

Any Gradute