Description

You will build and maintain data pipelines within an AWS environment.

Responsibilities

• Develop and manage ETL pipelines using Python and PySpark.
• Implement data processing workflows using AWS Glue and Lambda.
• Manage large-scale data processing tasks on EMR.
• Query and analyze data using Athena and Redshift.
• Optimize data storage and retrieval processes within S3.

Required Skills

• 6+ years of professional experience.
• 4+ years of experience with AWS services: Redshift, Lambda, Glue, S3, EMR, and Athena.
• 3+ years of hands-on experience with Python and PySpark.
• Proficiency in Python programming.
• Experience with Scala.
• Proven track record of building ETL pipelines.
• Any Graduate degree.

Key Skills

Education

Any Graduate