Description

You will design and develop scalable ETL pipelines leveraging AWS services.

Responsibilities

• Design and implement ETL pipelines using AWS Glue, Lambda, S3, and Redshift/RDS.
• Integrate data from APIs, databases, and flat files into AWS data platforms.
• Implement data transformation logic using PySpark, Python, or SQL.
• Orchestrate and monitor ETL workflows using AWS Step Functions, Glue Workflows, or Apache Airflow on MWAA.
• Optimize ETL performance, manage data quality, and implement security controls (encryption, IAM).

Required Skills

• 5+ years of experience in ETL development.
• Proficiency in PySpark and Python.
• Strong working knowledge of AWS services (Glue, Lambda, S3, Step Functions, etc.).
• Expertise in SQL.
• Familiarity with DevOps practices.
• Experience with Apache MWAA.
• Ability to implement data governance using AWS Glue Data Catalog and Lake Formation.

Key Skills

Education

Any Gradute