Description

You will design and implement cloud data pipelines, focusing on AWS and Databricks environments. You will construct real-time data streams and apply data lake architectural best practices.

Responsibilities

• Design and implement data pipelines within a cloud environment.
• Migrate and develop data solutions specifically within AWS.
• Build and implement data pipelines using Databricks or similar cloud databases.
• Construct real-time data streams using Spark.
• Apply architectural best practices to build and maintain data lakes.

Required Skills

• 4-6+ years of professional experience designing and implementing cloud data pipelines.
• 4+ years of experience developing data solutions in AWS.
• 2+ years of experience building pipelines with Databricks or similar cloud databases.
• Expert-level SQL skills for writing complex, optimized queries across large datasets.
• Hands-on object-oriented programming experience using Python.
• Professional experience building real-time data streams with Spark.
• Experience working with Spark frameworks.
• Knowledge of data lake architectural best practices.
• Any Graduate degree.

Preferred Skills

• Experience with other cloud platforms beyond AWS.
• Familiarity with additional stream processing tools.

Key Skills

Education

Any Graduate