Description

You will design, implement, and support Microsoft Azure infrastructure and data pipelines.

Responsibilities

• Design and implement Azure infrastructure using ARM templates and automate system configurations with Ansible playbooks.
• Develop YAML and PowerShell scripts for build and release pipelines to deploy Python applications.
• Configure and automate data pipelines and Spark cluster creation using Databricks and Azure Data Factory.
• Build real-time streaming operational data stores using Azure Event Hubs and Stream Analytics for Power BI reporting.
• Implement quality gates using SonarQube and Checkmarx to manage code coverage and security scans.

Required Skills

• 5+ years of experience in data engineering or cloud infrastructure.
• Proficiency in Python and Shell scripting.
• Hands-on experience with Azure Data Factory and Azure Blob Storage, ADLS Gen-1, and Gen-2.
• Experience with Databricks and Spark cluster orchestration.
• Ability to deploy Azure App Service into Private Virtual Networks with Internal Load Balancers.
• Knowledge of Azure Event Hubs and Stream Analytics.
• Experience with MS Power BI for corporate reporting.
• Skill in using SonarQube for code quality checks.
• Competency in ARM templates and Ansible.

Preferred Skills

• Experience with requirements gathering, project planning, and technical design documentation.

Key Skills

Education

Any Gradaute