Description

You will build and maintain data-driven solutions and ETL processes within an AWS environment.

Responsibilities

• Develop and implement data pipelines and ETL processes using PySpark and Unix.
• Analyze business processes to identify opportunities for optimization and improvement.
• Collaborate with stakeholders to gather, document, and implement technical requirements.
• Ensure data quality and integrity across all integrated systems and platforms.
• Maintain detailed documentation for all technical solutions and business processes.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with AWS services and their applications in data workflows.
• Strong experience with PySpark for large-scale data processing and analysis.
• Hands-on experience with Unix systems and shell scripting.
• Experience working within Agile methodologies.
• Proven ability to manage and deliver technical projects.
• Experience using data visualization tools and techniques.
• Bachelor's degree in a related field or equivalent professional experience.

Key Skills

Education

Any Graduate