Description

You will design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services. You will own the integrity and performance of data solutions from ingestion to visualization.

Responsibilities

• Build and optimize data pipelines using Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric.
• Query modern RDBMS (SQL Server, PostgreSQL) using SQL DML for efficient data retrieval and transformation.
• Develop and maintain reporting and automation solutions using Power BI, PowerApps, and Power Automate.
• Manage CI/CD processes for deploying data solutions using Azure DevOps pipelines and repositories.
• Validate data quality, troubleshoot pipeline issues, and collaborate with stakeholders to define requirements.

Required Skills

• 8+ years of experience in data engineering or similar roles dealing with ETL processes.
• Strong proficiency with Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric.
• Experience with Azure Data Lake Storage Gen 2 and Azure Blob Storage.
• Hands-on experience with Power BI, PowerApps, and Power Automate.
• Proficiency in SQL Server and PostgreSQL.
• Understanding of software engineering principles, including CI/CD, version control, and testing.
• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).

Preferred Skills

• Experience querying REST-API endpoints as data sources.
• Familiarity with Git workflows and Ansible in Azure DevOps pipelines.

Key Skills

Education

Bachelor’s degree