Description

Design, develop, and maintain end-to-end data ingestion and transformation pipelines using Azure Data Factory (ADF). Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data. Integrate data from multiple on-premises and cloud-based sources into enterprise data platforms. Develop and maintain Azure Data Lake Storage (ADLS) based data solutions. Monitor, troubleshoot, and optimize ADF pipelines to ensure reliability and performance. Collaborate with business stakeholders to gather requirements and translate them into scalable technical solutions. Implement data quality checks, validation mechanisms, and monitoring frameworks. Create reusable components, technical documentation, and best practices for data engineering projects. Support production deployments, issue resolution, and continuous improvement initiatives. Participate in code reviews and contribute to data architecture and design discussions

Key Skills

Education

Bachelor's degree