Description

You will design, develop, and implement scalable data-driven solutions using Azure Databricks while leading a technical team.

This role is hybrid.

Responsibilities

• Lead and mentor a team of technical professionals, overseeing code reviews and ensuring adherence to best practices.
• Design and implement data processing solutions using Azure Databricks, focusing on scalability and efficiency.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Oversee the full development lifecycle, from planning and design to deployment and maintenance.

Required Skills

• 7+ years of experience in data engineering roles.
• Proven expertise in Azure Databricks, including Spark, Data Pipelines, and Data Lakes.
• Strong programming skills in Python, Scala, or SQL.
• Experience with cloud-based data storage solutions, specifically Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Experience with CI/CD processes.

Preferred Skills

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.

Key Skills

Education

Any Graduate