Description

Skills Overview:
• SQL (5+ years)
• Apache Airflow (Cloud Composer) (3+ years)
• GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
• Python (5+ years)
• Big Data (warehousing/processing concepts, performance)(5+ years)
• Postgres (3+)

Experience
• Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
• Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
• Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
• Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
• Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
• Integrate Postgres sources/targets
• Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards

Key Skills

Education

Bachelor's degree