Description

You will build and manage data processing pipelines within the Google Cloud Platform ecosystem.

This role is on-site.

Responsibilities

• Develop and maintain data processing jobs using Spark and the Hadoop ecosystem.
• Write and optimize complex queries using HiveQL and SparkSQL.
• Execute data migration projects from Hadoop to cloud environments.
• Implement automation approaches to streamline data workflows.
• Participate in Agile development cycles to deliver incremental data solutions.

Required Skills

• Hands-on experience with Apache Spark.
• Deep understanding of Hadoop ecosystem components.
• Practical experience working within Google Cloud Platform (GCP).
• Proficiency in HiveQL and SparkSQL.
• Experience with Shell scripting.
• Degree in any graduate field.

Preferred Skills

• Programming experience in Java, Scala, or Python.
• Strong SQL fundamentals.
• Experience with workflow engines such as Oozie or Autosys.

Key Skills

Education

ANY GRADUATE