Description

You will build and maintain scalable ETL/ELT pipelines using Databricks and Azure cloud services.

This role is on-site.

Responsibilities

• Build and maintain scalable ETL/ELT pipelines using Databricks.
• Leverage PySpark and SQL to transform and process large datasets.
• Integrate data from Azure Blob Storage, ADLS, and relational/non-relational systems.
• Optimize Databricks workloads for cost efficiency and performance.
• Implement data security and governance standards using Unity Catalog.

Required Skills

• 5+ years of experience with Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture).
• Proficiency in Azure Cloud Services.
• Solid understanding of Spark and PySpark for big data processing.
• Experience with relational databases and SQL.
• Knowledge of Databricks Asset Bundles and GitLab for version control.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree