Description

Design and develop scalable data solutions using Azure Databricks for enterprise-level processing and analytics.

This role is on-site.

Responsibilities

• Lead the design and development of complex data pipelines using Azure Databricks.
• Write clean, efficient PySpark and Python code for data ingestion, transformation, and analytics.
• Implement and maintain ETL workflows to ensure high performance, data quality, and reliability.
• Monitor and optimize data workflows for scalability, cost-effectiveness, and operational efficiency.
• Mentor junior team members and participate in code reviews and design discussions.

Required Skills

• 7+ years of experience in data engineering.
• Expertise in Azure Databricks.
• Strong proficiency in PySpark.
• Strong proficiency in Python.
• Experience integrating Databricks with Azure data services.
• Ability to troubleshoot pipeline issues and ensure high availability.
• Experience with agile ceremonies and technical documentation.

Key Skills

Education

Any Graduate