Description

You will own the design and implementation of data ingestion, transformation, and processing pipelines.

Responsibilities

• Develop and operate scalable distributed data systems using GCP tools.
• Build solutions to support batch and streaming data workflows, including API interfaces.
• Guide and mentor data engineers, establishing best practices and ensuring code quality.
• Troubleshoot and optimize data pipelines and infrastructure for performance.
• Implement logging, monitoring, and alerting for data jobs and infrastructure.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong proficiency in Python, Java, and Scala.
• Expertise with SQL.
• Hands-on experience with GCP services including BigQuery, Dataflow, and Pub/Sub.
• Experience with DataFusion, DataProc, and Cloud Storage.
• Familiarity with ETL/ELT processes and data warehousing concepts.
• Experience driving Infrastructure as Code (IaC) using Terraform.

Key Skills

Education

Any Gradute