Description

Design and deliver technical solutions using Apache Airflow hosted on the Astronomer platform.

This role is remote.

Responsibilities

• Engineer Airflow-centric use cases and develop frameworks for large-scale pipeline deployments.
• Review, optimize, and tune data ingestion and extraction pipelines.
• Build architecture, data flow, and operational diagrams covering physical and logical layers.
• Provide reference implementations for data pipelines, new Airflow features, and third-party integrations.
• Collaborate with domain and engineering teams to build reusable assets, automation tools, and best practices.

Required Skills

• 5+ years of experience in technical roles with enterprise data experience in regulated environments.
• Hands-on experience with Apache Airflow in production environments.
• Proficiency in Python and SQL.
• Experience designing and implementing ETL, Data Warehousing, and ML/AI use cases.
• Experience migrating workflows from legacy schedulers like Tidal to Apache Airflow.
• Knowledge of Azure cloud-native data architecture and integrating with Azure Data Factory.
• Experience with Snowflake, Databricks, and working with containers.
• Experience with Kubernetes, either on-premise or in the cloud.
• Demonstrated technical leadership on team projects.

Preferred Skills

• Experience with Astronomer platform features.

Key Skills

Education

Any Gradute