Description

You will design and maintain complex data pipelines on Google Cloud Platform, ensuring data quality, security, and optimal performance for client solutions.

This role is on-site.

Responsibilities

• Build and optimize data pipelines using Python, SQL, and Google Dataflow to integrate and cleanse data from multiple sources.
• Design complex data models and implement data quality checks to troubleshoot anomalies and ensure reliability.
• Implement security best practices across pipeline infrastructure and cloud environments.
• Mentor junior data engineers, review their implementations, and guide adoption strategies for global teams.
• Evaluate and propose new GCP technologies and data management best practices.

Required Skills

• 10+ years of experience as a data engineer or in a related role.
• Strong proficiency in Python and SQL.
• Intermediate experience with Google Cloud Platform (GCP) concepts and services.
• Hands-on experience with Google Dataflow, BigQuery, and Bigtable.
• Proficiency in Spark, PySpark, or Scala for data processing.
• Advanced Git usage and CI/CD integration skills.
• Experience with data formats such as JSON, AVRO, and PARQUET.

Preferred Skills

• Master’s degree in a STEM discipline.
• Experience with Entity Resolution concepts or projects.
• GCP cloud certification.

Key Skills

Education

Any Graduate