Description
You design, build, and maintain scalable Azure Data Factory pipelines for ingestion, orchestration, and transformation, supporting enterprise data migration and modernization.
This role is remote.
Responsibilities
- Develop and optimize SQL/T-SQL scripts, stored procedures, and transformation logic within Azure ecosystems.
- Implement multizone data lake architectures (Bronze/Silver/Gold) and support Azure governance standards including RBAC and Key Vault.
- Extract and migrate data from legacy/mainframe environments such as IMS DB/DC and DB2, handling validation and delta loads.
- Build automated monitoring, logging, and error-handling frameworks for data pipelines and CI/CD deployment processes.
- Create technical documentation, including source-to-target mapping, and support data classification for sensitive elements.
Required Skills
- 7+ years of experience in data engineering, ETL development, or cloud data modernization.
- Strong hands-on expertise with Azure Data Factory (ADF) and Azure SQL.
- Experience with Azure Data Lake Storage (ADLS) and Azure cloud ecosystems.
- Proficiency in SQL and T-SQL development.
- Proven experience building multizone data lake solutions.
- Experience migrating data from legacy or mainframe environments.
- Familiarity with DevOps, CI/CD processes, and automated validation frameworks.
Preferred Skills
- Experience with Dynamics 365 data integration.
- Background in implementing automated monitoring and alerting systems.