Description

You will design, build, and maintain scalable data pipelines using Google Cloud Platform.

Responsibilities

• Design, build, and maintain scalable data pipelines leveraging GCP services.
• Develop and maintain ETL/ELT pipelines using Python and SQL.
• Build automated CI/CD pipelines using Cloud Build, GitHub Actions, or Jenkins.
• Set up observability using Cloud Monitoring, Cloud Logging, and Error Reporting.
• Develop integrations with external systems, including APIs and flat files.

Required Skills

• 8+ years in data engineering with expertise in GCP (BigQuery, Cloud Storage, Cloud Composer, Dataproc).
• Proficiency in Python and SQL for data pipeline development.
• Experience with distributed data processing frameworks like Hadoop.
• Familiarity with infrastructure as code using Terraform.
• Experience implementing CI/CD practices.
• Knowledge of streaming data pipelines using Pub/Sub or Dataflow.
• Experience with Kafka.
• Ability to work independently and collaboratively with cross-functional teams.

Preferred Skills

• Familiarity with data governance, security, and compliance in cloud platforms.

Key Skills

Education

Any Gradute