Description

You will design and maintain complex data pipelines on Google Cloud Platform, ensuring data quality, security, and optimal performance for client solutions.

This role is on-site.

Responsibilities

  • Build and optimize data pipelines using Python, SQL, and Google Dataflow to integrate and cleanse data from multiple sources.
  • Design complex data models and implement data quality checks to troubleshoot anomalies and ensure reliability.
  • Implement security best practices across pipeline infrastructure and cloud environments.
  • Mentor junior data engineers, review their implementations, and guide adoption strategies for global teams.
  • Evaluate and propose new GCP technologies and data management best practices.

Required Skills

  • 10+ years of experience as a data engineer or in a related role.
  • Strong proficiency in Python and SQL.
  • Intermediate experience with Google Cloud Platform (GCP) concepts and services.
  • Hands-on experience with Google Dataflow, BigQuery, and Bigtable.
  • Proficiency in Spark, PySpark, or Scala for data processing.
  • Advanced Git usage and CI/CD integration skills.
  • Experience with data formats such as JSON, AVRO, and PARQUET.

Preferred Skills

  • Master’s degree in a STEM discipline.
  • Experience with Entity Resolution concepts or projects.
  • GCP cloud certification.

Education

Any Graduate