Description

You will be an Azure Databricks Engineer responsible for data pipeline development and deployment.

Responsibilities

• Develop and manage data workflows using Azure Data Factory (ADF) or Azure Databricks (ADB).
• Engineer solutions utilizing Azure components such as Azure SQL Database and Azure SQL Warehouse.
• Implement data processing logic using Python, PySpark, Scala, or Hive.
• Build and maintain CI/CD pipelines for data environments.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise with Azure Databricks (ADB).
• Proficiency in Azure Data Factory (ADF).
• Strong programming skills in Python and PySpark.
• Experience with Scala and Hive.
• Familiarity with Azure SQL Database and Azure SQL Warehouse.
• Ability to work independently and within a team environment.

Key Skills

Education

Any Graduate