Description
You will build and maintain data infrastructure and pipelines.
Responsibilities
- Develop and manage ETL processes using Azure Data Factory Pipelines.
- Process and transform data using Azure Synapse Data Flows.
- Implement CI/CD workflows for Data Bricks and Azure Data Factory.
- Write and optimize complex SQL queries for data manipulation.
Required Skills
- 7-10 Years of professional experience in data engineering.
- Hands-on expertise with Azure Data Bricks using Python.
- Strong practical understanding of Azure Data Factory Pipelines.
- Proficiency in Azure Synapse Data Flows.
- Experience understanding Power BI Data flows.
- Demonstrated ability to write production-level SQL code.
- Experience with CI/CD practices applied to Data Bricks and ADF.
- Familiarity with version control using Azure DevOps Git.