Description

You will build and manage data pipelines using the Databricks platform on Azure infrastructure.

Responsibilities

• Develop and maintain Databricks notebooks, clusters, and jobs.
• Implement data storage and governance using Delta Lake and Unity Catalog.
• Design and execute ETL/ELT methodologies and dimensional modeling.
• Manage streaming data technologies and data warehousing processes.
• Utilize Git or other version control systems for collaborative development.

Required Skills

• 10+ years of professional experience.
• Deep hands-on experience with Databricks.
• Proficiency with Delta Lake and Unity Catalog.
• Extensive experience with Azure cloud infrastructure.
• Strong understanding of ETL/ELT methodologies.
• Experience with streaming data technologies.
• Solid grasp of data warehousing principles and dimensional modeling.
• Proficiency in Databricks programming languages.
• Familiarity with Git for version control.

Key Skills

Education

Any Graduate