Description

You will design, build, test, and support data integrations for Partner IQ Experience.

This role is remote.

Responsibilities

• Design, build, and support data integration pipelines.
• Implement data quality validation, testing, and monitoring processes.
• Manage data workflows using orchestration tools.
• Optimize data warehousing structures and ETL/ELT patterns.

Required Skills

• 8-10 years of experience in Data Engineering.
• Expertise in GCP, with experience in AWS or Azure equivalent cloud platforms.
• Proficiency in Python for building data pipelines.
• Advanced SQL skills, including window functions and CTEs.
• Experience with GCP BigQuery (query optimization, partitioning, clustering, data modeling).
• Familiarity with Cloud Composer (Apache Airflow) for workflow orchestration.
• Knowledge of Data Governance Principles and Data Warehousing (Dimensional modeling).
• Experience with Cloud Storage bucket management and lifecycle policies.
• Proficiency in Bash/Shell for automation and scripting.

Preferred Skills

• Experience with Dataflow (Apache Beam) for streaming/batch processing.
• Familiarity with Pub/Sub for event-driven architecture.

Key Skills

Education

Bachelor's degree