Description

Job Description

We are looking for an experienced Azure Databricks Engineer with strong expertise in Azure Data Engineering, Python, PySpark, and data pipeline development. The ideal candidate should have hands-on experience designing, developing, and maintaining scalable data processing workflows using Azure cloud services.

Key Responsibilities

• Design, develop, and maintain data pipelines and data processing workflows on Azure.
• Develop and optimize data solutions using Azure Databricks and PySpark.
• Build and manage ETL workflows using Azure Data Factory (ADF).
• Write efficient Python code for data processing, automation, and debugging.
• Work with Azure Data Lake, Azure SQL, and Azure Synapse Analytics for data storage and analytics solutions.
• Troubleshoot and optimize data processing jobs for performance and reliability.
• Collaborate with cross-functional teams to deliver scalable data engineering solutions.

Required Skills & Experience

• Strong hands-on expertise in Python with excellent debugging skills.
• Extensive experience with Python-based data engineering solutions.
• Strong understanding of Azure Data Engineering concepts.
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Azure Databricks (ADB)
  • Python
  • PySpark
  • SQL
• Experience in building and maintaining data pipelines and data processing workflows on Azure

Key Skills

Education

Any Graduate