Description

You will design and build data acquisition, transformation, and modeling solutions on AWS.

Responsibilities

• Build data acquisition and transformation pipelines using Python and Apache Spark.
• Design and implement data models within cloud or data lake environments.
• Perform data analysis to identify and resolve quality issues.
• Debug and troubleshoot code issues within existing data workflows.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python and Apache Spark.
• Strong SQL writing skills.
• Hands-on AWS experience, specifically with S3 buckets and Lambda.
• Experience with Terraform and Jenkins.
• Knowledge of cloud security practices.
• Experience using migration tools.
• Practical understanding of data modeling in the cloud.
• Ability to work in Agile environments.

Preferred Skills

• Experience with AWS Glue.
• Experience with Informatica.

Key Skills

Education

Any gradudate