Description

You will design and implement data pipelines within a cloud environment, focusing on AWS and Databricks.

This role is on-site.

Responsibilities

• Design and implement scalable data pipelines in cloud environments.
• Develop and migrate data solutions specifically within AWS.
• Build and implement data pipelines using Databricks or similar cloud databases.
• Write complex, highly optimized SQL queries to process large volumes of data.
• Build real-time data streams using Spark.

Required Skills

• 9+ years of professional experience designing and implementing data pipelines.
• 5+ years of experience developing or migrating data solutions in AWS.
• 2+ years of experience building data pipelines using Databricks.
• Expert-level SQL for complex query optimization across large datasets.
• Hands-on object-oriented programming experience using Python.
• Professional experience building real-time data streams with Spark.
• Knowledge of architectural best practices for building data lakes.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate