Description

Lead the design and delivery of scalable data integration and warehouse solutions using AWS services.

This role is hybrid.

Responsibilities

• Design and build end-to-end ETL/ELT workflows using AWS Glue and PySpark.
• Orchestrate data pipelines with Airflow to ensure high data quality and reliability.
• Implement CI/CD pipelines and Infrastructure as Code (Terraform) for automated deployments.
• Leverage AWS services including Lambda, EventBridge, S3, RDS, Aurora, MSK, and Kinesis to build event-driven architectures.
• Influence technical and business stakeholders while leading cross-functional collaboration.

Required Skills

• 10+ years of experience in data engineering and ETL development.
• Hands-on expertise with AWS Glue, PySpark, and SQL.
• Proficiency in CI/CD tools and Terraform for infrastructure management.
• Experience with orchestration tools like Airflow.
• Strong knowledge of AWS ecosystem (S3, Lambda, EventBridge, RDS Aurora, MSK, Kinesis).
• Excellent communication and leadership capabilities.

Preferred Skills

• AWS certifications (Solutions Architect, DevOps Engineer).
• Experience with Snowflake, MS SQL Server, or PostgreSQL.

Key Skills

Education

Bachelor's degree