Description

Build and manage data infrastructure and pipelines on AWS.

This role is hybrid.

Responsibilities

• Design and build data pipelines and orchestration workflows using Apache Airflow.
• Implement data migration strategies and construct Data Lakes, ODS, EDW, and Data Marts.
• Develop and manage data warehousing solutions, ensuring data integrity across the lifecycle.
• Utilize AWS services (EKS, EMR, Glue, HashiCorp Vault, Docker, Kubernetes) to deploy and run data workloads.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert proficiency in Python and PySpark.
• Deep, hands-on experience with Apache Airflow for orchestration.
• Strong expertise in SQL and the complete Data Warehousing lifecycle.
• Proven experience with core AWS Services, including EKS, EMR, Glue, and HashiCorp Vault.
• Familiarity with containerization technologies like Docker and Kubernetes.

Preferred Skills

• Experience with DBT for ETL/ELT processes.
• Demonstrated Agile project planning and effort estimation skills.

Key Skills

Education

Any Gradute