Description

You will build and maintain data pipelines and cloud-based solutions to support data-driven decision-making.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines using PySpark and Airflow.
• Implement and manage cloud-based solutions on AWS.
• Monitor and troubleshoot data workflows to ensure smooth operations.
• Collaborate with stakeholders to gather and document business requirements.
• Analyze business processes to identify areas for optimization and improvement.

Required Skills

• 6 to 9 years of experience in data engineering roles.
• Proficiency with PySpark for data processing.
• Experience orchestrating workflows with Airflow.
• Hands-on experience managing solutions on AWS.
• Strong technical skills in Unix environments.
• Ability to lead cross-functional teams to implement solutions.
• Experience creating detailed reports to communicate technical findings.
• Ensure data integrity and security across all platforms.

Preferred Skills

• Degree in any graduate field.

Key Skills

Education

Any Graduate