Description

Build and maintain production data pipelines on GCP, focusing on reusable components and AI-ready data enablement.

This role is on-site.

Responsibilities

• Develop and maintain production data pipelines on GCP with a focus on data product development and reusable components.
• Implement transformations and standardized data models using DBT, ensuring reliable and scalable downstream consumption.
• Build and operate workflow orchestration using Airflow/Cloud Composer, including scheduling, monitoring, and troubleshooting.
• Develop ingestion and serving logic in BigQuery using Python and SQL, optimizing for performance and correctness.
• Support semantic search and AI-ready data enablement patterns, including data preparation for ML/GenAI consumption.

Required Skills

• 5+ years of experience in GCP-based data platform development and production data pipeline implementation.
• Hands-on experience with BigQuery, Airflow (Cloud Composer), DBT, Python, and SQL.
• Experience building ingestion and serving logic in BigQuery.
• Proficiency in Python and SQL for building and maintaining production data pipelines and transformations.
• Familiarity with Pub/Sub and Metadata management.
• Experience with semantic search enablement using production-grade data models.

Preferred Skills

• Additional cloud exposure (AWS/Azure).
• Familiarity with AI/ML data enablement patterns.

Education

B.E., B.Tech, M.Tech, MCA, or equivalent in Computer Engineering/Science/Information Security/Technology.

Key Skills

Education

Any Graduate