Description

You will build and maintain scalable data pipelines and API services within the Azure ecosystem.

Responsibilities

• Develop scalable code using Python and Spark to handle complex data processing tasks.
• Optimize Spark jobs and manage SQL-based API deployments in Azure.
• Debug multi-process architectures and manage Python threading limitations.
• Implement and manage data storage using ADLS, Cosmos DB, and Key Vault.
• Collaborate on technical projects and manage version control via Azure Git.

Required Skills

• 4-6 years of experience as a Spark and Python developer.
• Proficiency in Python with at least one framework such as Django, Flask, or Pyramid.
• Hands-on experience with Azure Databricks and ADLS Storage.
• Strong SQL skills for data management and API creation.
• Experience with Azure Key Vault and Cosmos DB.
• Knowledge of Active Directory Authentication.
• Proficiency with Visual Studio Code and pandas.
• Experience with Unit, Functional, and Load testing tools.
• Ability to work with Azure DevOps and ARM template scripts.

Preferred Skills

• Knowledge of Delta Lake and Unity Catalog.
• Experience with API Management (APIM) or Gateways.

Key Skills

Education

Any Graduate