Description

Design, implement, and maintain data solutions on Microsoft Azure. Own the end-to-end lifecycle of data pipelines, ensuring secure and compliant movement, transformation, and integration from source systems to target destinations.

Responsibilities

• Build and maintain data pipelines for data movement, transformation, and integration.
• Design and manage Azure storage solutions, including Azure Data Lake, Azure SQL Database, and Azure Blob Storage.
• Process and transform data using Azure Databricks and dbt, ensuring consistency between development and production environments.
• Optimize SQL queries generated by dbt to improve performance and ensure data quality.
• Implement secure and compliant data processing pipelines to produce cleansed datasets for analysis.

Required Skills

• 5+ years of experience as an Azure Data Engineer or in a similar role.
• Expertise in Microsoft Azure services and Azure Databricks.
• Proficiency in Python and SQL.
• Hands-on experience with dbt and running dbt transformations in production via Azure Databricks.
• Experience managing datasets and data integration workflows.
• Proven ability in performance optimization and SQL query tuning.
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Certified Azure Data Engineer.

Preferred Skills

• Knowledge of data catalog tools such as Microsoft Purview.

Key Skills

Education

Bachelor's Degree