Description

Job Description:
We are seeking a specialist with strong experience in designing and developing scalable data solutions using Azure Databricks.
Design, develop, and optimize scalable data pipelines using Azure Databricks
Implement and maintain ETL workflows ensuring high performance, data quality, and reliability
Integrate Azure Databricks with Azure data services to build robust data platforms
Monitor and optimize workflows for scalability, cost efficiency, and performance
Collaborate with cross-functional teams to align technical solutions with business needs
Stay updated with the latest Azure Databricks advancements and best practices
Roles & Responsibilities:
Lead design, development, and enhancement of complex data pipelines
Write clean, efficient PySpark and Python code for ingestion, transformation, and analytics
Troubleshoot and resolve data pipeline issues to ensure high availability
Work closely with data architects, analysts, and stakeholders
Mentor junior team members on Azure Databricks best practices
Document data architectures, workflows, and processes
Participate in design discussions, code reviews, and agile ceremonies

Key Skills

Education

Any Graduate