Description

You will design and manage large-scale data processing workflows on GCP.

Responsibilities

• Build and maintain data pipelines using PySpark and Scala.
• Host and manage applications on GCP using DataProc, Composer, and BigQuery.
• Monitor system health and data pipeline performance using Grafana.
• Orchestrate complex workflows using Airflow.

Required Skills

• 12+ years of professional experience in IT.
• 10+ years of Data Engineering experience.
• 8+ years of experience with PySpark and Scala.
• 7 years of experience specifically with Scala.
• 5+ years of experience hosting applications on GCP.
• Proficiency with Spark and PySpark.
• Experience with GCP services including DataProc, Composer, and BigQuery.
• Experience with Airflow and Grafana.
• Any Graduate degree.

Key Skills

Education

Any Graduate