Description

Build and maintain scalable data pipelines using Databricks on Azure.

This role is hybrid.

Responsibilities

• Design and implement ETL/ELT pipelines for databases, APIs, and streaming sources.
• Manage data transformations, cleansing, and storage optimization within Databricks.
• Translate business requirements into technical specifications for data solutions.
• Maintain cluster configurations, jobs, and notebooks.
• Ensure data quality and reliability across the platform.

Required Skills

• 10+ years of engineering experience.
• Deep hands-on experience with Databricks (notebooks, clusters, jobs, Unity Catalog).
• Proficiency in Azure cloud infrastructure.
• Strong understanding of ETL/ELT methodologies and data warehousing principles.
• Experience with streaming data technologies.
• Proficiency in Databricks programming languages (SQL, Python, Scala).
• Experience working with databases and APIs.
• Familiarity with Git or version control systems.

Preferred Skills

• Experience with data quality frameworks.
• Knowledge of CI/CD for data pipelines.

Key Skills

Education

Any Gradute