Description

You will build and manage scalable data architectures using Azure Databricks.

Responsibilities

• Design and implement ETL/ELT pipelines to move data from Azure SQL into Databricks Delta Lake.
• Lead the migration of workloads from Azure SQL to Azure Databricks.
• Optimize Spark jobs, Azure SQL queries, and indexing strategies to improve performance and cost efficiency.
• Implement data governance, security, and compliance standards within Azure environments.
• Maintain and optimize data processing, storage, and retrieval workflows.

Required Skills

• 5+ years of experience in data engineering.
• Expertise with Apache Spark.
• Hands-on experience with Delta Lake.
• Proficiency with Azure Databricks.
• Strong knowledge of Azure SQL.
• Experience designing scalable data architectures.
• Ability to troubleshoot and fine-tune distributed computing workloads.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate