Description

Mandatory Skills

* 10+ years of overall Data Engineering experience.

* Strong recent hands-on experience with Azure Databricks.

* Experience with Lakeflow Declarative Pipelines.

* Hands-on experience with Unity Catalog and migration from legacy workspaces.

* Strong experience in Data Vault modelling and data modelling concepts.

* Excellent hands-on skills in Python, PySpark, and SQL.

* Experience with Azure Data Factory, ADLS, Azure Synapse, and Azure Blob Storage.

* Strong knowledge of ETL/ELT, Apache Spark, Kafka, and Hadoop.

* Experience with data governance and data quality.

* Understanding of cloud security including Entra ID/Azure AD, Key Vault, RBAC, and secure connectivity.

* Experience with on-premises infrastructure / clusters such as Cloudera or Hortonworks is an advantage.

* Recent end-to-end Databricks implementation experience.

Preferred

* Databricks performance optimization and Delta Lake.

* Experience with Airflow, Informatica, Talend, or NiFi.

* Azure DevOps / CI-CD / Terraform

Key Skills

Education

Any Gradute