Description

Design and develop scalable data solutions and pipelines using Azure Databricks.

This role is on-site.

Responsibilities

• Lead the design and development of complex data pipelines using Azure Databricks.
• Write clean, efficient PySpark and Python code for data ingestion, transformation, and analytics.
• Implement and maintain ETL workflows to ensure high performance, data quality, and reliability.
• Troubleshoot pipeline issues to minimize downtime and optimize cost effectiveness.
• Collaborate with data architects and stakeholders to align solutions with business objectives.

Required Skills

• 7+ years of experience in data engineering.
• Expertise in Azure Databricks.
• Strong proficiency in PySpark and Python.
• Experience designing and optimizing ETL workflows.
• Ability to build scalable data platforms on Azure.
• Experience mentoring junior team members.
• Understanding of data architecture and compliance documentation.

Preferred Skills

• Experience with agile ceremonies and code reviews.
• Knowledge of Azure data services integration.

Key Skills

Education

Any Graduate