Description

You will build and manage large-scale data processing pipelines.

This role is on-site.

Responsibilities

• Design and develop ETL pipelines using PySpark, AWS EMR, and AWS Glue.
• Optimize Spark jobs for performance, scalability, and cost efficiency in cloud environments.
• Manage data transformations, cleansing, and enrichment to ensure high data quality.
• Monitor, troubleshoot, and enhance ETL workflows for reliability and efficiency.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with PySpark and AWS EMR.
• Proficiency in Python.
• Experience with AWS S3, Lambda, and Redshift.
• Familiarity with ETL pipeline design and development.

Key Skills

Education

Any Gradute