Description

Lead a team of engineers through hands-on technical guidance while building and managing data pipelines.

Responsibilities

• Build and maintain data pipelines for batch and streaming workloads using AWS technologies.
• Translate technical requirements and coordinate updates with business stakeholders.
• Provide direct technical leadership and hands-on guidance to the engineering team.
• Collaborate on solutions to meet consumer needs and drive delivery innovation.

Required Skills

• 5+ years of experience in Data Engineering.
• Proficiency with PySpark and Spark for data processing.
• Hands-on experience with Apache Airflow for orchestration.
• Working knowledge of AWS stack: EC2, S3, IAM, Lambda, Glue, and SNS.
• Experience with CI/CD tools and Infrastructure as Code using Terraform.
• Proficiency with version control systems and JIRA.
• Ability to design and implement both streaming and batch data pipelines.

Key Skills

Education

Any gradudate