Description

Lead a team of 3-5 developers to build, manage, and optimize data integration pipelines within AWS environments.

This role is on-site.

Responsibilities

• Lead and independently manage a PySpark development team of 3-5 members.
• Develop, test, deploy, and maintain data integration pipelines in AWS.
• Improve existing data pipelines to ensure efficiency and reliability.
• Execute technical strategy for data processing workflows.
• Manage technical delivery and team coordination.

Required Skills

• 5+ years of professional experience.
• Hands-on experience with PySpark and Python.
• Extensive experience using AWS EMR.
• Experience working with AWS Glue, Kafka, Kinesis, and Lambda.
• Proficiency in managing data within S3, Redshift, and RDS.
• Direct experience with Apache Spark in a cloud environment.

Preferred Skills

• Any graduate degree.

Key Skills

Education

any graduate