Description

You will design and maintain ETL pipelines using PySpark on AWS Glue.

Responsibilities

• Develop and optimize PySpark scripts for data transformation.
• Build and manage ETL jobs within the AWS Glue environment.
• Debug and resolve performance issues in data processing workflows.
• Cleanse and structure raw data for downstream consumption.

Required Skills

• 6-8 years of experience in data engineering or ETL development.
• Strong proficiency in PySpark for distributed data processing.
• Hands-on experience with AWS Glue for job orchestration.
• Solid understanding of SQL and data modeling concepts.
• Ability to work independently in a remote capacity.
• Bachelor's degree in a relevant technical field.

Preferred Skills

• Experience with AWS S3 and DynamoDB.

Key Skills

Education

Any Graduate