Description

You will design and build data pipelines and manage large-scale data architectures on AWS.

Responsibilities

• Build and orchestrate data pipelines using Apache Airflow.
• Develop and maintain Operational Data Stores, Enterprise Data Warehouses, Data Lakes, and Data Marts.
• Execute complex data migrations and implement ETL/ELT workflows.
• Collaborate with Business and IT stakeholders to align technical delivery with requirements.

Required Skills

• 10+ years of experience in data development and migration.
• 8+ years of hands-on experience with Python and PySpark.
• Extensive experience with AWS services including EKS, EMR, and Glue.
• Proficiency in SQL and the full Data Warehousing life cycle.
• Experience with containerization and orchestration using Docker and Kubernetes.
• Practical knowledge of Apache Airflow for pipeline orchestration.
• Experience managing secrets and configuration with HashiCorp Vault.
• Bachelor's degree in any field.

Preferred Skills

• Experience with cloud ETL/ELT using DBT, Glue, or EMR.

Key Skills

Education

Any Gradute