Description

You will design and implement scalable data pipelines within a cloud environment, focusing on AWS and Databricks.

Responsibilities

• Design and implement scalable data pipelines in a cloud environment.
• Develop and migrate data solutions specifically within AWS.
• Build and maintain data pipelines using Databricks or similar cloud databases.
• Develop real-time data streams using Spark.
• Apply architectural best practices for building data lakes.

Required Skills

• 9+ years of professional experience designing and implementing cloud data pipelines.
• 5+ years of experience developing data solutions in AWS.
• 2+ years of experience building pipelines with Databricks.
• Expert-level SQL skills for writing complex, optimized queries on large datasets.
• Hands-on experience with object-oriented programming in Python.
• Professional experience building real-time data streams with Spark.
• Practical knowledge of Spark frameworks.
• Experience implementing data lake architectures.

Key Skills

Education

Not specified