Description

Own the design, build, and maintenance of data integrations and pipelines on Google Cloud Platform.

Responsibilities

• Design and implement resilient data solutions ensuring operational readiness and stability.
• Develop and maintain data pipelines using Python and Apache Airflow on GCP.
• Optimize BigQuery performance through query tuning, partitioning, clustering, and cost management.
• Manage Cloud Storage lifecycle policies, data archival, and bucket management.
• Implement data governance, quality validation, and monitoring via Cloud Logging and Monitoring.

Required Skills

• 8+ years of experience in Data Engineering.
• Strong proficiency in Python for data engineering and pipeline development.
• Hands-on experience with Google Cloud Platform, specifically BigQuery and Cloud Composer.
• Expertise in Apache Airflow for workflow orchestration.
• Advanced SQL skills including window functions and CTEs.
• Experience with Cloud Storage, including bucket management and lifecycle policies.
• Knowledge of data warehousing concepts, dimensional modeling, and ETL/ELT patterns.
• Proficiency in Bash/Shell scripting for automation.
• Experience with Git for version control.

Preferred Skills

• Experience with Dataflow (Apache Beam) for streaming and batch processing.
• Familiarity with Pub/Sub for event-driven architectures.
• Background in PBM or Healthcare data domains.

Key Skills

Education

Any Graduate