Description

You will lead the design and implementation of scalable data processing solutions using Azure Databricks and mentor a team of technical professionals.

This role is on-site.

Responsibilities

• Design and implement data pipelines and data lakes using Azure Databricks, Spark, and Python/Scala.
• Lead and mentor a team, conducting code reviews to ensure quality and adherence to best practices.
• Collaborate with cross-functional teams to translate business requirements into technical specifications.
• Oversee the full development lifecycle, from planning and design to deployment and maintenance.
• Facilitate communication between technical and non-technical stakeholders to align on project goals.

Required Skills

• 7-10 years of experience in data engineering or software development.
• Proven expertise in Azure Databricks, Spark, and cloud-based data storage (Azure Data Lake Storage, Azure SQL Database).
• Strong programming skills in Python, Scala, or SQL.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Demonstrated ability to lead technical teams and manage multiple projects simultaneously.
• Bachelor's degree in Computer Science, IT, or related field.

Preferred Skills

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.
• Knowledge of data governance and compliance standards.

Key Skills

Education

Any Gradute