Description

Build and maintain scalable data pipelines on Google Cloud Platform using Python.

This role is on-site.

Responsibilities

• Develop and optimize data workflows using Python and GCP services like BigQuery, Dataproc, and Dataflow.
• Manage cloud infrastructure including IAM, KMS, GCS, and Cloud SQL.
• Implement CI/CD pipelines and use Git for version control.
• Troubleshoot provisioning issues related to permissions, quotas, and resource conflicts.

Required Skills

• 5+ years of experience as a Data Engineer.
• Strong proficiency in Python programming.
• Hands-on experience with Google Cloud Platform services including BigQuery, Cloud Composer, and Bigtable.
• Familiarity with CI/CD concepts and Git.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with distributed data processing frameworks.
• Knowledge of Dataplex and Data Catalog.

Key Skills

Education

Bachelor's degree