Description

You will lead the design and development of scalable data processing systems and end-to-end technical solutions.

This role is on-site.

Responsibilities

• Design and develop scalable data processing systems using Python and PySpark.
• Translate complex business requirements into robust technical architectures.
• Manage data projects from initial conception through production deployment.
• Mentor team members to improve technical capabilities and engineering standards.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in Python and PySpark, including Spark architecture and performance tuning.
• Proficiency in SQL with experience writing and optimizing complex queries.
• Hands-on experience with AWS services: Glue, Lambda, API Gateway, and S3.
• Experience building and managing CI/CD pipelines.
• Strong analytical and problem-solving capabilities for technical troubleshooting.
• Effective communication skills for conveying technical concepts to stakeholders.

Preferred Skills

• Experience with AWS CloudFormation.
• Working knowledge of Unix environments.

Key Skills

Education

Any Graduate