Description

You will build and manage data infrastructure to support data-driven decision-making.

Responsibilities

• Develop and maintain data pipelines using PySpark and Airflow.
• Implement and manage cloud-based solutions on AWS.
• Monitor and troubleshoot data workflows to ensure smooth operations.
• Analyze business processes to identify areas for optimization and improvement.
• Ensure data integrity and security across all platforms.

Required Skills

• 6+ years of experience in data engineering roles.
• Proficiency with PySpark for data processing.
• Experience managing workflows with Airflow.
• Hands-on experience implementing solutions on AWS.
• Strong technical skills in Unix environments.
• Ability to create detailed documentation and technical reports.
• Proven track record of implementing business solutions.

Key Skills

Education

Any Graduate