Description

You will design and build data pipelines using Google Cloud Platform services.

Responsibilities

• Develop data processing logic primarily in Python and PySpark.
• Manage and optimize data storage and querying within GCP-GCS and BigQuery.
• Translate SQL for BigQuery Migration Service tasks.
• Utilize Cloud Composer for workflow orchestration.

Required Skills

• 12+ years of relevant experience in data engineering.
• Expert proficiency in Python.
• Strong experience with PySpark.
• Hands-on experience with GCP ecosystem (GC-S, BigQuery).
• Proficiency in SQL.
• Familiarity with Teradata.
• Bachelor's degree in Computer Science or equivalent.

Key Skills

Education

Bachelor's degree