Description

You will own the design, development, and maintenance of data pipelines and transformations.

Responsibilities

• Develop ETL scripts and implement business logic using Python.
• Design and manage data transformations using DBT within BigQuery.
• Orchestrate complex data workflows using Airflow and Cloud Composer.
• Implement data ingestion mechanisms from various sources, including SFTP.

Required Skills

• 10+ years of professional experience in a data engineering role.
• Expert proficiency in Python for data manipulation (pandas, NumPy) and ETL scripting.
• Strong SQL skills, specifically PL/SQL, for data transformation and persistence layer interactions.
• Hands-on experience with DBT for building data models and documentation.
• Proven experience with orchestration tools like Airflow and Cloud Composer.
• Deep working knowledge of Google Cloud Platform (GCP) services, particularly BigQuery.
• Experience implementing data ingestion patterns using Cloud Functions and Cloud Run.

Key Skills

Education

Any Graduate