Description

You will design and implement scalable data processing solutions using Azure Databricks.

This role is on-site.

Responsibilities

• Design and implement data processing solutions ensuring scalability and efficiency.
• Translate business requirements into technical specifications in collaboration with cross-functional teams.
• Oversee the full development lifecycle from planning and design through deployment and maintenance.
• Conduct code reviews to ensure quality and adherence to best practices.
• Identify and mitigate risks associated with project delivery.

Required Skills

• 12+ years of experience as a Data Engineer.
• Proven expertise in Azure Databricks, Spark, and data lakes.
• Strong programming skills in Python, Scala, or SQL.
• Experience with Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Proficiency in building data pipelines and ETL workflows.
• Familiarity with CI/CD processes using Azure DevOps.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with machine learning frameworks and libraries.
• Knowledge of data governance and compliance standards.

Key Skills

Education

Bachelor's degree