Description

You will administer, configure, and optimize the Azure Databricks platform while owning end-to-end data engineering projects.

This role is hybrid.

Responsibilities

• Build large-scale batch and real-time data pipelines using Azure data processing frameworks.
• Develop, test, and modify software to improve data platform and application efficiency.
• Integrate data from various sources, ensuring data quality and accessibility standards.
• Analyze and design technical solutions on Azure to address specific business needs.
• Recreate legacy application logic in Azure Databricks and Data Lake.

Required Skills

• 7+ years of IT professional experience in Azure Cloud development.
• Expertise in Azure Databricks and Python.
• Proficiency with Azure Data Factory, Azure Functions, and Azure Data Lake Storage.
• Strong SQL skills, including T-SQL and working with SQL Server.
• Experience managing infrastructure integration with network and security components.
• Familiarity with CI/CD using Azure DevOps.
• Experience with software configuration management tools like Git/Gitlab.
• Knowledge of integrating streaming data use-cases in a big data environment.

Key Skills

Education

Any Graduate