Description

You will design and maintain scalable data pipelines and development workflows within an AWS environment.

This role is on-site.

Responsibilities

• Build and manage ETL processes using Python and Spark.
• Develop data pipelines to support large-scale data processing.
• Implement and maintain streaming solutions using Kafka.
• Integrate AWS Glue into existing data architectures.

Required Skills

• 12+ years of professional experience in data engineering.
• 3+ years of Python experience specifically focused on data pipelines and development.
• Expertise in Spark and PySpark.
• Hands-on experience with AWS services, including proficiency with AWS Glue.
• Proven track record with ETL development.
• Required experience with Kafka.

Preferred Skills

• Experience with Amazon EMR.

Key Skills

Education

Any Graduation