Description

Build and optimize data infrastructure to support analytics and reporting. You will own the end-to-end data pipeline lifecycle, from ingestion to model maintenance.

Responsibilities

• Implement automated data pipelines using AWS Glue and AWS Lambda.
• Optimize large-scale data processing performance with Spark and AWS EMR.
• Develop and maintain complex data models and databases.
• Extract, transform, and analyze data from various sources using SQL and Python.
• Mentor junior analysts on technical skills and best practices.

Required Skills

• 8+ years of experience in data engineering.
• Proficiency in Python and SQL.
• Hands-on experience with AWS Glue and AWS Lambda.
• Experience with AWS EMR and Spark for large-scale data processing.
• Working knowledge of Amazon DynamoDB and AWS EC2.
• Strong proficiency in Unix environments.
• Degree in any graduate field.

Key Skills

Education

Any Graduate