Description

You will build and manage ETL pipelines and data workflows within a GCP environment.

Responsibilities

• Develop and maintain ETL processes using SQL and Teradata.
• Manage data orchestration using Airflow and Cloud Composer.
• Implement and monitor GCP services including BigQuery, Dataflow, and Pub-Sub.
• Utilize Cloud Monitoring to ensure pipeline health and performance.

Required Skills

• 5+ years of experience in data engineering.
• Strong SQL background for complex data manipulation.
• Hands-on experience with Teradata.
• Proficiency with GCP services: BigQuery, Composer, Dataflow, and Pub-Sub.
• Experience with Airflow or Cloud Composer for orchestration.
• Experience with Cloud Monitoring.
• Bachelor's degree or equivalent graduate-level education.

Preferred Skills

• Experience with Kubernetes and Docker containers.
• Ability to deploy GCP services using containerization.

Key Skills

Education

Any Graduate