Description

You design, build, and lead data engineering solutions on Azure Databricks, mentoring a team of technical professionals to ensure scalable, efficient data pipelines and lakes.

You will own the full development lifecycle, from requirements gathering and technical specification to deployment, maintenance, and code quality reviews.

Responsibilities

• Lead and mentor a team of engineers, conducting code reviews and fostering technical best practices.
• Design and implement scalable data processing solutions using Azure Databricks, Spark, and data lakes.
• Collaborate with cross-functional teams to translate business requirements into technical specifications.
• Oversee project delivery, identifying risks and ensuring alignment between technical and non-technical stakeholders.
• Maintain up-to-date knowledge of Azure Databricks trends and emerging data engineering technologies.

Required Skills

• 12+ years of experience in data engineering, software development, or related technical roles.
• Proven expertise in Azure Databricks, including Spark, data pipelines, and data lakes.
• Strong programming skills in Python, Scala, or SQL.
• Experience with Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Ability to lead technical teams and manage multiple projects simultaneously.

Preferred Skills

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.
• Knowledge of data governance and compliance standards.

Key Skills

Education

Bachelor's degree