Description

You will own the data ingestion and transformation pipeline using Google Cloud Platform services.

Responsibilities

  • Ingest data into BigQuery using Google Pub/Sub and Cloud Composer.
  • Manage data transformations and orchestration with Dataform.
  • Store and manage raw data assets in Google Cloud Storage.
  • Utilize GitHub for version control and collaboration.
  • Document processes and track tasks using Jira and Confluence.

Required Skills

  • 5+ years of experience in data engineering.
  • Hands-on experience with Google Pub/Sub, BigQuery, and Dataform.
  • Proficiency in SQL for data querying and manipulation.
  • Experience with Google Cloud Storage and Cloud Composer.
  • Strong familiarity with GitHub workflows.
  • Ability to integrate with various databases and services.

Preferred Skills

  • Experience with Cloud Data Fusion.
  • DBMS connectivity experience with SQL Server, DB2, or Oracle.
  • Experience calling RESTful APIs and SOAP Web Services.

Key Skills
Education

Any Graduate

Back To Jobs