Description
You will build and maintain data infrastructure and pipelines.
Responsibilities
- Develop and manage ETL processes using Azure Data Factory Pipelines.
- Process and transform data using Azure Synapse Data Flows.
- Implement CI/CD workflows for Databricks and Azure Data Factory.
- Write and optimize complex SQL queries for data manipulation.
Required Skills
- 7-10 years of professional experience in data engineering.
- Hands-on expertise with Azure Databricks using Python.
- Strong practical understanding of Azure Data Factory Pipelines.
- Proficiency in Azure Synapse Data Flows.
- Experience understanding Power BI Data flows.
- Proven ability to write production-level SQL code.
- Experience with CI/CD practices applied to Databricks and ADF.
- Familiarity with version control using Azure DevOps Git.