Description

You will build and maintain data pipelines within a GCP environment.

This role is on-site.

Responsibilities

• Develop data processing workflows using Spark and PySpark.
• Optimize complex queries to improve data retrieval efficiency.
• Manage data orchestration using Airflow.
• Operate within Linux/Unix and Shell environments to maintain data infrastructure.
• Utilize GCP Dataproc technologies for large-scale data processing.

Required Skills

• 4-10 years of experience in data engineering.
• Proficiency in Spark, Hive, and Hadoop.
• Experience with GCP and Dataproc.
• Strong programming skills in Python, PySpark, or Scala.
• Hands-on experience with Airflow.
• Competency in Linux, Unix, or Shell environments.
• Proven ability in query optimization.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate