Description

Design and deliver scalable data pipelines using Azure Data Factory, integrated with Azure Functions and Web APIs. Build high-performance ingestion frameworks to move data from multiple source systems into Dynamics 365 Dataverse, leveraging the Dataverse Bulk API for large-scale loads. Migrate large volumes of records with a focus on performance optimization, error handling, retry logic, and API throttling management. Implement cloud-native integration patterns and batch-oriented ingestion to ensure enterprise-grade data reliability.

Responsibilities

• Design and implement scalable data pipelines using Azure Data Factory.
• Integrate Azure Functions and Web APIs to support data processing workflows.
• Build ingestion frameworks for migrating data into Dynamics 365 Dataverse.
• Optimize large-scale data loads using the Dataverse Bulk API.
• Manage API throttling, error handling, and retry logic for data reliability.

Required Skills

• 7–9 years of hands-on experience in data integration and pipeline design.
• Expertise in Azure Data Factory for building and managing data pipelines.
• Strong proficiency with Azure Functions and Web APIs.
• Experience with Dynamics 365 Dataverse and the Dataverse Bulk API.
• Proven track record of migrating 2+ million records with performance optimization.
• Understanding of cloud-native integration patterns and batch-oriented ingestion.
• Ability to handle error handling, retry logic, and API throttling.

Preferred Skills

• Experience with enterprise-grade data reliability and optimization techniques.

Key Skills

Education

Any Gradute