Description

You will design, build, and optimize scalable data pipelines on GCP for enterprise analytics, migration, and reporting.

This role is on-site.

Responsibilities

• Build and maintain large-scale data ecosystems supporting real-time and batch processing.
• Automate data ingestion, transformation, and validation workflows for CI/CD.
• Collaborate with data architects and scientists to define requirements and efficient data workflows.
• Monitor pipeline performance, troubleshoot failures, and optimize for throughput and reliability.
• Support cloud migration, schema design, and data validation while ensuring governance compliance.

Required Skills

• 4+ years of experience designing, deploying, and optimizing enterprise big data pipelines in cloud environments.
• Strong proficiency in Python for scripting, automation, and data transformation.
• Hands-on experience with Spark and Hive for big data processing and large dataset management.
• Expert SQL skills for data validation, query optimization, and relational database management.
• Experience with GCP for cloud-native data processing and migration.
• Knowledge of data modeling, schema design, and data validation for data lakes and warehouses.
• Familiarity with automation tools like Terraform or cloud-specific providers.

Preferred Skills

• Experience with Apache Airflow or equivalent for data orchestration and scheduling.
• Proficiency in visualization tools such as Power BI or Tableau for operational dashboards.

Referral Bonus: ₹50,000

Key Skills

Education

Bachelor's degree