Description

You will design and build complex Delta Lake architectures and data pipelines.

This role is on-site.

Responsibilities

• Build and maintain complex Delta Lake architectures.
• Develop ETL processes and data pipeline tools.
• Design and document data pipeline architecture and design.
• Integrate REST APIs, messaging, and event technologies into data workflows.

Required Skills

• 6+ years of experience in data engineering.
• Strong proficiency in Python.
• Hands-on experience with Databricks.
• Experience working within AWS or Azure Cloud platforms.
• Experience building ETL pipelines.
• Experience with Kafka or similar streaming platforms.
• Experience working with REST APIs and services.

Preferred Skills

• Experience with Airflow.

Key Skills

Education

Any Graduate