Description

You will design and implement data pipelines within a cloud environment, focusing on AWS, Databricks, and real-time streaming with Spark.

This role is on-site.

Responsibilities

• Design and implement scalable data pipelines in a cloud environment.
• Develop and migrate data solutions specifically within AWS.
• Build and implement data pipelines using Databricks or similar cloud databases.
• Write complex, highly-optimized SQL queries to process large volumes of data.
• Construct real-time data streams using Spark and PySpark.

Required Skills

• 5+ years of professional experience designing and implementing data pipelines.
• 2+ years of experience developing or migrating data solutions in AWS.
• 1+ years of experience building pipelines with Databricks or similar cloud databases.
• Expert-level SQL skills for complex query optimization on large datasets.
• Hands-on object-oriented programming experience with Python.
• Professional experience building real-time data streams using Spark.
• Knowledge of architectural best practices for building data lakes.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate