Description

You will design and implement scalable data pipelines within the Google Cloud Platform ecosystem.

Responsibilities

• Design and implement data pipelines using BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
• Build and maintain data models and ETL processes to support analytics and reporting.
• Optimize data storage and retrieval for performance and cost-effectiveness.
• Monitor and troubleshoot production pipelines to ensure data quality and system reliability.
• Implement security best practices to ensure data integrity and regulatory compliance.

Required Skills

• 5+ years of experience in data engineering or related fields.
• Proficiency with GCP services: BigQuery, Dataflow, Cloud Storage, Cloud Composer (Airflow), and Pub/Sub.
• Strong programming skills in Python and Java.
• Hands-on experience with SQL for querying and transforming data.
• Experience building scalable ETL/ELT pipelines and data warehousing.
• Understanding of distributed computing and cloud-based architecture.
• Familiarity with CI/CD pipelines for deploying data workflows.
• Degree in any graduate field.

Preferred Skills

• Experience with AWS or Azure.
• Knowledge of Spark, Hadoop, or other big data technologies.
• Familiarity with Kubernetes or containerized applications.
• Background in machine learning or data science.

Key Skills

Education

Any Graduate