Description

You will design and build data pipelines within the DAAP environment using Azure Data Factory and Synapse.

Responsibilities

• Build end-to-end data processing workflows and orchestration using automated triggers and schedules.
• Develop PySpark and Scala notebooks to pull data from ServiceNow APIs and load it into SQL pools.
• Create Logic Apps to automate workflows and manage system alerts or notifications.
• Implement Azure Functions for event-driven processing and data hub preparation.
• Integrate Azure DevOps for CI/CD and release management.

Required Skills

• 14+ years of total professional experience.
• Expertise in Azure Data Factory and Azure Synapse.
• Proficiency in PySpark and Scala for data transformation.
• Experience with SQL and data lake storage.
• Ability to implement recursive and iterative logic for complex data retrieval.
• Experience making API calls to integrate systems like Avaya, Eureka, and Zammo.
• Hands-on experience with Azure DevOps and CI/CD pipelines.
• Knowledge of Azure Logic Apps and Azure Functions.

Key Skills

Education

Any Gradute