Description

You will design and maintain config-driven data pipelines using Databricks and Azure Data Factory.

This role is remote.

Responsibilities

• Build and manage data workflows using Databricks and Azure Data Factory.
• Develop scalable data processing solutions with PySpark and Python.
• Write and optimize Databricks SQL queries for analytics.
• Maintain config-driven pipeline architectures for reliability.
• Collaborate on data engineering best practices.

Required Skills

• 6+ years of experience in data engineering.
• Strong proficiency in Databricks and Databricks SQL.
• Experience with Azure Data Factory.
• Hands-on skills with PySpark and Python.
• Ability to design config-driven data pipelines.

Preferred Skills

• Experience with large-scale distributed data systems.
• Knowledge of cloud-native data architecture patterns.

Key Skills

Education

Any Graduate