Description

Lead a team of 3-5 developers to build and manage data integration pipelines within AWS environments.

Responsibilities

• Lead and independently manage a PySpark development team of 3-5 members.
• Develop, test, deploy, and maintain data integration pipelines in AWS.
• Improve existing data pipelines to ensure efficiency and reliability.
• Execute technical strategy for data processing workflows.

Required Skills

• 5+ years of professional experience.
• Mandatory hands-on experience with PySpark and Python.
• Extensive experience using AWS EMR.
• Experience working with AWS Glue, Kafka, Kinesis, and Lambda.
• Proficiency in managing data within S3, Redshift, and RDS.
• Direct experience with Apache Spark in a cloud environment.
• Ability to manage technical delivery and team coordination.

Preferred Skills

• Any graduate degree.

Key Skills

Education

any graduate