Description

You will design and manage scalable data processing workflows on Google Cloud Platform.

This role is on-site.

Responsibilities

• Build and maintain scalable data pipelines using Spark and Scala.
• Orchestrate complex workflows and task scheduling with Airflow.
• Manage large-scale data processing tasks within Hadoop ecosystems.
• Develop and optimize SQL queries for data warehousing.
• Implement CI/CD practices to automate data engineering deployments.

Required Skills

• 10+ years of professional experience in data engineering.
• Proficiency with Spark and Scala for distributed computing.
• Strong experience with Hadoop and distributed systems.
• Expertise in SQL and data warehousing principles.
• Hands-on experience with Airflow for workflow orchestration.
• Practical knowledge of GCP infrastructure.
• Experience implementing CI/CD pipelines.

Preferred Skills

• Experience with Kafka and streaming architectures.
• Hands-on experience with Looker.

Key Skills

Education

Any Graduate