Description

You will design and implement scalable data pipelines within the Google Cloud Platform ecosystem, owning the lifecycle from ingestion to analytics support.

Responsibilities

• Design and implement data pipelines using BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
• Build and maintain data models and ETL processes to support analytics and reporting.
• Optimize data storage and retrieval for performance and cost-effectiveness.
• Monitor and troubleshoot production pipelines to ensure data quality and system reliability.
• Implement security best practices to ensure data integrity and regulatory compliance.

Required Skills

• 5+ years of experience in data engineering or related fields.
• Proficiency with GCP services: BigQuery, Dataflow, Cloud Storage, Cloud Composer (Airflow), and Pub/Sub.
• Strong programming skills in Python and Java.
• Hands-on experience with SQL for querying and transforming data.
• Knowledge of data modeling, data warehousing, and building scalable ETL/ELT pipelines.
• Familiarity with CI/CD pipelines for deploying and managing data workflows.
• Solid understanding of distributed computing and cloud-based architecture.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with AWS or Azure.
• Knowledge of Spark, Hadoop, or other big data technologies.
• Familiarity with Kubernetes or containerised applications.

Key Skills

Education

Bachelor's degree in Computer Science