Description

Lead technical implementations and manage data infrastructure within the Google Cloud Platform ecosystem.

Responsibilities

• Manage and configure data integration processes to extract, transform, and load data from various sources into appropriate storage systems.
• Support data ingestion pipelines, processing workflows, and storage solutions using Cloud Storage, BigQuery, Dataflow, and Composer.
• Optimize data structures, queries, and long-running jobs for performance and scalability.
• Own BigQuery operations including object provision automation, capacity management, and DDL statement changes.
• Monitor pipelines for quality issues, troubleshoot data-related problems, and document infrastructure and workflows.

Required Skills

• 5+ years of professional experience in data engineering or related roles.
• Deep expertise with Google Cloud Platform (GCP) services.
• Advanced proficiency in BigQuery, including tuning and capacity management.
• Strong programming skills in Python.
• Expert-level SQL for data manipulation and DDL operations.
• Experience with Apache Airflow and Composer.
• Hands-on experience with DataProc and Data Fusion.
• Ability to manage CI/CD pipelines.
• Experience with Cloud Storage and Dataflow.

Preferred Skills

• Experience providing configuration details for Terraform deployments.

Key Skills

Education

Any Graduate