Description

You will build on-premises applications to ingest Azure Purview classification results and load them into a data mart for sensitivity reporting.

Responsibilities

• Build on-premises applications connecting to Azure EventHub and Purview APIs.
• Extract and process classification information from Azure to support data sensitivity reporting.
• Define custom classifications within Purview to meet specific project requirements.
• Integrate data flows between on-premises environments and Azure cloud services.

Required Skills

• 5+ years of Python programming experience, including Collections, OOP, higher-order functions, Pandas, exception handling, and multiprocessing.
• Experience with Python packaging, design, and architectural patterns.
• Hands-on Azure experience with Azure Functions, Data Lake Storage Gen2, Databricks, and Cosmos DB.
• Proficiency with Azure Data Factory and EventGrid/EventHub using AMQP or Kafka endpoints.
• Practical knowledge of Purview APIs and custom classification definitions.
• Experience with Linux environments and shell scripting.
• Strong understanding of SQL and database management.
• Proficiency with version control using Git or Bitbucket.
• Experience with streaming services like Kafka.

Preferred Skills

• Experience with PyTest or UnitTest for manual and automated testing.
• Ability to translate agile storyboards and use cases into functional applications.
• Skill in optimizing applications for speed, scalability, and high availability.

Key Skills

Education

Any Graduate