Description

You will design and implement scalable data solutions using Azure Databricks. You own the architecture for data pipelines, lakes, and real-time processing systems.

Responsibilities

• Design and implement scalable data pipelines, data lakes, and real-time processing systems on Azure Databricks.
• Lead implementation efforts while ensuring best practices for performance, security, and data governance.
• Integrate Databricks with Azure Data Lake, Azure Synapse Analytics, and Azure SQL Database.
• Optimize data workflows and queries for performance and cost efficiency.
• Mentor junior team members and maintain architecture and process documentation.

Required Skills

• 5+ years of experience as a Data Architect or in a similar role.
• Extensive experience designing and implementing solutions on Azure Databricks.
• Proficiency with Apache Spark and data processing frameworks.
• Strong experience with Azure services including Azure Data Lake, Azure Synapse, and Azure SQL.
• Working knowledge of Python, Scala, or SQL.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Ability to manage multiple projects and prioritize tasks effectively.

Preferred Skills

• Azure Data Engineer certification.
• Azure Solutions Architect certification.

Key Skills

Education

Any Graduate