Description

You will build and manage scalable data pipelines within the Google Cloud ecosystem.

Responsibilities

• Design and develop data pipelines using BigQuery and Dataflow.
• Implement ETL and ELT processes to handle structured and unstructured data from diverse sources.
• Optimize data workflows using Apache Beam and Cloud Composer for real-time streaming.
• Automate data processes and infrastructure using Terraform and Python.
• Manage data security, governance, and access control through encryption and policy implementation.
• Monitor and debug pipelines to ensure high performance for analytics and business operations.

Required Skills

• 5+ years of experience in data engineering.
• Google Cloud Platform (GCP).
• BigQuery.
• Python.
• Terraform.
• Cloud Functions.
• MySQL.
• Kubernetes.
• Any Graduate degree.

Key Skills

Education

Any Graduate