You will design and maintain complex data pipelines on Google Cloud Platform, ensuring data quality, security, and optimal performance for client solutions.
This role is on-site.
Responsibilities
- Build and optimize data pipelines using Python, SQL, and Google Dataflow to integrate and cleanse data from multiple sources.
- Design complex data models and implement data quality checks to troubleshoot anomalies and ensure reliability.
- Implement security best practices across pipeline infrastructure and cloud environments.
- Mentor junior data engineers, review their implementations, and guide adoption strategies for global teams.
- Evaluate and propose new GCP technologies and data management best practices.
Required Skills
- 10+ years of experience as a data engineer or in a related role.
- Strong proficiency in Python and SQL.
- Intermediate experience with Google Cloud Platform (GCP) concepts and services.
- Hands-on experience with Google Dataflow, BigQuery, and Bigtable.
- Proficiency in Spark, PySpark, or Scala for data processing.
- Advanced Git usage and CI/CD integration skills.
- Experience with data formats such as JSON, AVRO, and PARQUET.
Preferred Skills
- Master’s degree in a STEM discipline.
- Experience with Entity Resolution concepts or projects.
- GCP cloud certification.