Description

You will design, build, and maintain scalable ETL pipelines and data solutions on AWS using Python and PySpark.

This role is on-site.

Responsibilities

• Build and maintain ETL pipelines using Python and PySpark on AWS Glue.
• Orchestrate workflows with AWS Step Functions and serverless components like Lambda.
• Implement messaging and event-driven patterns using AWS SNS and SQS.
• Design and optimize data storage and querying in Amazon Redshift with performant SQL.
• Ensure data quality, monitoring, error handling, and operational support for pipelines.

Required Skills

• Strong experience with Python and PySpark for large-scale data processing.
• Hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions.
• Solid SQL skills and familiarity with data modeling and query optimization.
• Experience with ETL best practices, data quality checks, and monitoring/alerting.
• Familiarity with version control (Git) and basic DevOps/CI-CD workflows.
• 5+ years of professional experience.

Key Skills

Education

Any Graduate