Description

Build and maintain data pipelines to migrate on-premises SQL databases to GCP.

Responsibilities

• Load data from DB2, SQL Server, and Oracle into GCP using Qlik and Attunity.
• Develop and maintain ETL workflows within the GCP ecosystem.
• Optimize data processing tasks using Spark and Hadoop.
• Manage data movement processes and ensure pipeline reliability.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and SQL.
• Hands-on experience with GCP services including BigQuery and Dataproc.
• Experience with Spark and Hadoop frameworks.
• Working knowledge of ETL processes.
• Experience managing data in SQL databases such as DB2, SQL Server, or Oracle.
• Familiarity with Astronomer.
• Experience with Attunity.

Preferred Skills

• Prior experience migrating on-premises data to cloud environments.

Key Skills

Education

Any Graduate