Description

Lead engineering teams while building and managing batch and streaming data pipelines on AWS.

This role is on-site.

Responsibilities

• Build and maintain data pipelines for batch and streaming workloads using AWS technologies.
• Provide hands-on technical guidance and leadership to the engineering team.
• Translate technical requirements and coordinate updates with business stakeholders.
• Collaborate on solutions to meet consumer needs and drive delivery innovation.

Required Skills

• 5+ years of experience in Data Engineering.
• Proficiency with PySpark and Spark for data processing.
• Hands-on experience with Apache Airflow for orchestration.
• Working knowledge of AWS stack: EC2, S3, IAM, Lambda, Glue, and SNS.
• Experience with CI/CD tools and Infrastructure as Code using Terraform.
• Proficiency with version control systems and JIRA.
• Ability to design and implement both streaming and batch data pipelines.

Key Skills

Education

Any gradudate