Description

You will design, develop, and implement data-driven system applications on Google Cloud Platform. You own the full lifecycle of data processing flows.

Responsibilities

• Design and develop optimized data pipelines for batch and real-time processing.
• Write and optimize complex SQL and Spark DataFrames for large-scale data processing and joins.
• Analyze, design, and support the implementation of system applications and software processing flows.
• Develop and document technical and functional specifications for data systems.

Required Skills

• 10+ years of overall professional experience.
• 3+ years of hands-on experience with BigQuery, DataProc, Airflow, and Cloud Composer.
• Proficiency in Python, PySpark, or Scala.
• Strong understanding of Spark architecture, including Spark Core, SQL, and PySpark.
• Experience with Map-Reduce and Hive.
• Ability to program using Core Java or Python.
• Strong SQL skills for processing massive datasets.
• Experience with GCP Hydra Services and Cloud Data Optimization.
• Any Graduate degree.

Key Skills

Education

Any Graduate