Description

Lead and mentor a team of data engineers to design, build, and maintain scalable data processing solutions using Azure Databricks.

This role is on-site.

Responsibilities

• Design and implement data pipelines and data lake architectures using Azure Databricks, Spark, and Python or Scala.
• Lead and mentor technical professionals, conducting code reviews and fostering best practices for code quality.
• Translate business requirements into technical specifications and oversee the full development lifecycle from planning to deployment.
• Manage multiple projects simultaneously, identifying risks and ensuring alignment between technical and non-technical stakeholders.
• Collaborate with cross-functional teams to integrate data warehousing solutions and ensure efficient ETL processes.

Required Skills

• 12+ years of experience in data engineering, software development, or related technical roles.
• Proven expertise in Azure Databricks, including deep knowledge of Spark, data pipelines, and data lakes.
• Strong programming skills in Python, Scala, or SQL.
• Experience with cloud-based data storage solutions, specifically Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Demonstrated ability to lead technical teams and manage project delivery.

Preferred Skills

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.
• Knowledge of data governance and compliance standards.

Key Skills

Education

Bachelor's degree