Description

You will build and manage data pipelines within an AWS environment.

Responsibilities

• Develop data processing workflows using Databricks and PySpark.
• Implement data transformations using Spark Core and Spark SQL.
• Maintain data engineering pipelines on AWS infrastructure.
• Collaborate within an Agile development framework.

Required Skills

• 8+ years of total experience in Information Technology.
• 4+ years of experience as an AWS Data Engineer.
• 4+ years of hands-on experience with Databricks.
• 4+ years of experience using PySpark.
• Proficiency in Spark Core.
• Proficiency in Spark SQL.
• Experience working in Agile environments.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Experience with AWS-specific data services.

Key Skills

Education

Any Graduate