← Back to jobs

UST Logo
GCP with PySpark - Lead

UST

 

Thiruvananthapuram, Kerala, India

Posted On: 30+ days ago
Experience: 6+ years
Availability: Onsite
Openings: 2
Category: GCP Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will lead the design and implementation of end-to-end data pipelines on Google Cloud Platform.

This role is on-site.

Responsibilities

  • Design, implement, and optimize scalable data pipelines on GCP.
  • Develop and maintain ETL workflows for efficient data processing.
  • Leverage PySpark for advanced data transformations, cleansing, and validation.
  • Utilize BigQuery, Cloud Storage, and Dataflow to manage data engineering tasks.
  • Implement and manage data storage solutions within the GCP ecosystem.

Required Skills

  • 6+ years of experience in data engineering.
  • Expertise in PySpark for data processing and analytics.
  • Proficiency with GCP services including BigQuery, Cloud Storage, and Dataflow.
  • Strong programming skills in Python, SQL, or Scala.
  • Hands-on experience with ETL processes and data modeling.
  • Experience with data warehousing architectures.

Preferred Skills

  • Relevant certifications in GCP or data engineering.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs