Description

You will engineer and implement data processing solutions using Azure Databricks.

Responsibilities

• Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
• Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
• Oversee the development lifecycle, from planning and design to deployment and maintenance.
• Conduct code reviews and provide constructive feedback to team members to ensure code quality.
• Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.

Required Skills

• Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
• Strong programming skills in Python, Scala, or SQL.
• Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of Data Modeling, ETL processes, and Data Warehousing concepts.
• Demonstrated ability to lead technical teams and manage multiple projects simultaneously.
• Experience in Data Engineering and Software Development.
• 12+ years of experience in data engineering, software development, or a related technical role.

Preferred Skills

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.

Key Skills

Education

Bachelor's degree