Description
You will design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services, owning data solution integrity from ingestion to visualization.
This role is on-site.
Responsibilities
- Build and optimize data pipelines using Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric.
- Query modern RDBMS (SQL Server, PostgreSQL) using SQL DML for efficient data retrieval and transformation.
- Develop and maintain reporting and automation solutions using Power BI, PowerApps, and Power Automate.
- Manage CI/CD processes for deploying data solutions using Azure DevOps pipelines and repositories.
- Validate data quality, troubleshoot pipeline issues, and collaborate with stakeholders to define requirements.
Required Skills
- 8+ years of experience in data engineering or similar roles dealing with ETL processes.
- Strong proficiency with Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric.
- Experience with Azure Data Lake Storage Gen 2 and Azure Blob Storage.
- Hands-on experience with Power BI, PowerApps, and Power Automate.
- Proficiency in SQL Server and PostgreSQL.
- Understanding of software engineering principles, including CI/CD, version control, and testing.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
Preferred Skills
- Experience querying REST-API endpoints as data sources.
- Familiarity with Git workflows and Ansible in Azure DevOps pipelines.