Description

Design, develop, and optimize scalable data pipelines using Azure Databricks.

This role is on-site.

Responsibilities

• Lead design, development, and enhancement of complex data pipelines.
• Implement and maintain ETL workflows ensuring high performance, data quality, and reliability.
• Integrate Azure Databricks with Azure data services to build robust data platforms.
• Troubleshoot and resolve data pipeline issues to ensure high availability.
• Document data architectures, workflows, and processes.

Required Skills

• 7+ years of experience in data engineering.
• Strong proficiency in Azure Databricks.
• Expert-level PySpark and Python coding.
• Experience designing scalable data solutions.
• Ability to optimize workflows for scalability and cost efficiency.
• Collaboration with cross-functional teams and stakeholders.
• Experience mentoring junior team members.
• Participation in code reviews and agile ceremonies.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate