Description

You will design and maintain scalable ETL/ELT pipelines on Azure, focusing on performance, governance, and reliability.

This role is on-site.

Responsibilities

• Build and optimize big data solutions using Azure Databricks and Apache Spark.
• Develop data transformation workflows using Python and SQL.
• Configure Unity Catalog for data governance and access control.
• Manage Azure Data Lake Storage (ADLS) and Delta Tables for enterprise data solutions.
• Troubleshoot production issues and support continuous improvement initiatives.

Required Skills

• 6+ years of experience in Data Engineering.
• Strong knowledge of SQL and Python.
• Hands-on experience with Azure Databricks and Azure Data Factory (ADF).
• Expertise with Apache Spark, Delta Tables, and Delta Lake.
• Hands-on knowledge of Unity Catalog.
• Experience with Azure Data Lake Storage (ADLS).
• Strong understanding of ETL/ELT, data warehousing, and data modeling.
• Familiarity with Git, CI/CD, and Azure cloud services.

Preferred Skills

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Microsoft Azure Data Engineer certification.

Key Skills

Education

Bachelor's or Master's degrees