Description

You will design, implement, and maintain data and analytical solutions on Microsoft Azure.

Responsibilities

• Build and maintain data pipelines to facilitate movement, transformation, and integration from source systems to target destinations.
• Design and manage data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Blob Storage.
• Process and transform data using Databricks, dbt, and various orchestration tools.
• Optimize SQL queries and ensure consistency between development and production environments.
• Implement secure, compliant pipelines to produce cleansed datasets for analysis.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Microsoft Azure environments.
• Strong experience with Azure Databricks.
• Advanced SQL skills for data processing and query optimization.
• Proficiency in Python.
• Hands-on experience designing and managing data pipelines.
• Experience with relational databases including Microsoft SQL Server, Oracle, and SingleStore.
• Knowledge of dbt for data transformation.
• Familiarity with data orchestration tools.

Preferred Skills

• Knowledge of data catalog tools such as Microsoft Purview.

Key Skills

Education

Any Graduate