Description

You will own the implementation and maintenance of data pipelines using Databricks on AWS.

This role is on-site.

Responsibilities

• Develop and optimize data solutions using Databricks and Snowflake within cloud environments.
• Conduct performance tuning on complex SQL queries for optimal execution speed.
• Design and implement data warehousing, data modelling, and data lake structures.
• Automate processes using DevOps principles, CI/CD, and orchestration tools.

Required Skills

• 12+ years of hands-on experience with AWS and Databricks.
• Strong proficiency in Databricks and Snowflake, specifically on Azure Cloud platform.
• Expertise in writing complex SQL queries.
• Solid understanding of data warehousing, data modelling, and data lake concepts.
• Experience with CI/CD, DevOps, orchestration, and automation.
• Familiarity with Azure services such as Azure Data Lake Storage, Azure SQL Database, and Azure EventHub/EventGrid.
• Experience working within Agile methodology.

Key Skills

Education

Any Graduate