Description

Key Responsibilities:• Design and implement scalable batch and streaming data pipelines on Google Cloud Platform(GCP)• Build and manage data platforms using Medallion Architecture (Bronze, Silver, Gold layers)• Develop high-performance data transformations using PySpark and Python• Write and optimize complex analytical queries using Advanced SQL• Work extensively with BigQuery for large-scale data processing and performance tuning• Develop pipelines using Cloud Dataflow• Orchestrate workflows using Cloud Composer (Airflow)• Manage storage and data lifecycle using Google Cloud Storage (GCS)• Implement version control and CI/CD pipelines using Git• Ensure secure access management and governance using GCP IAM• Optimize performance, scalability, reliability, and cost-efficiency of cloud data solutionsRequired Skills and Experience:• Strong hands-on experience in Google Cloud Platform (GCP)• Expertise in BigQuery including partitioning, clustering, and query optimization• Experience implementing Medallion Data Architecture• Strong programming skills in Python and PySpark• Advanced SQL expertise with experience handling complex queries• Hands-on experience with Cloud Dataflow• Experience with Cloud Composer (Airflow)• Experience working with Google Cloud Storage (GCS)• Knowledge of Version Control and CI/CD practices using Git• Understanding of GCP IAM and cloud security best practices

Key Skills

Education

Bachelor's degree