Description
You will design and build data infrastructure for large-scale data processing.
This role is on-site.
Responsibilities
- Build and optimize large-scale ETL pipelines for high-availability environments.
- Design resilient and efficient ETL processes compliant with regulatory standards.
- Implement data governance, security protocols, and RBAC within the Azure ecosystem.
- Develop complex data transformations using Spark, Python, and/or Scala.
Required Skills
- 7+ years of experience in ETL Development and Data Engineering.
- 3+ years working with Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview.
- Expertise in Spark, Python, and/or Scala for large-scale data transformations.
- Strong proficiency in Structured Query Language (SQL) for complex data structures.
- In-depth knowledge of data governance and security protocols in Azure.
- Familiarity with Azure Data Factory (ADF).