Description

You will build and manage data pipelines within an AWS environment.

This role is hybrid.

Responsibilities

• Develop and optimize data processing workflows using PySpark and Python.
• Manage large-scale datasets using AWS S3 and Redshift.
• Build serverless orchestration logic with Lambda and Step Functions.
• Maintain data transformation processes using AWS Glue and EMR.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in PySpark and Python.
• Strong SQL skills for data manipulation and analysis.
• Hands-on experience with AWS S3 and Athena.
• Experience building ETL pipelines with AWS Glue.
• Practical knowledge of EMR and Spark clusters.
• Experience with AWS Redshift data warehousing.

Preferred Skills

• Ability to implement serverless workflows using AWS Lambda and Step Functions.

Key Skills

Education

Any Graduate