Description

You will build and manage data pipelines for ingestion, transformation, and distribution of large datasets within GCP.

Responsibilities

• Design and maintain ELT data pipelines from scratch for structured, semi-structured, and unstructured data.
• Automate data workflows and streamline engineering processes using GCP services.
• Collaborate with stakeholders and product managers to develop data mapping, models, and reporting solutions.
• Monitor pipeline performance and conduct regular data quality checks.
• Work within DevOps and Scrum teams to integrate data processes into CI/CD pipelines.

Required Skills

• 10+ years of experience with Data Warehouse and Data Platforms.
• 5+ years of experience with GCP, including Dataproc, BigQuery, Cloud Spanner, Cloud Run Functions, Dataflow, and Pub/Sub.
• 5+ years of experience in data engineering, programming, and ETL/ELT processes.
• 5+ years of experience with CI/CD pipelines and source control using Github, Bitbucket, or Terraform.
• 5+ years of experience creating ELT pipelines and working with SQL and large datasets.
• 2+ years of experience configuring data ingestion tools such as Fivetran, Qlik, or Airbyte.
• Strong scripting skills and experience with source control systems.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate