Description

You will build and manage scalable data pipelines within the Google Cloud ecosystem.

Responsibilities

• Design and develop data pipelines using BigQuery and Dataflow to handle ingestion, transformation, and storage.
• Build ETL and ELT processes to manage structured and unstructured data from diverse sources.
• Optimize data workflows using Apache Beam and Cloud Composer for real-time streaming.
• Automate data processes and infrastructure using Terraform and Python.
• Implement data security, governance, and encryption policies to ensure compliance.
• Monitor and debug pipelines to provide high-quality datasets for analysts and data scientists.

Required Skills

• 6+ years of experience in data engineering roles.
• Proficiency with Google Cloud Platform (GCP) services.
• Hands-on experience with BigQuery.
• Strong Python scripting skills.
• Experience with Terraform for infrastructure automation.
• Working knowledge of MySQL.
• Experience with Kubernetes orchestration.
• Ability to work on-site in Navi Mumbai.

Key Skills

Education

Any Graduate