Description

You will build and maintain core infrastructure and automation pipelines for data processing systems.

This role is on-site.

Responsibilities

• Write PySpark scripts and Python code to support data processing workflows.
• Implement solutions leveraging Azure Data Bricks (ADB) and Azure Data Factory (ADF).
• Perform performance tuning and optimization on existing systems.
• Write complex SQL queries for data extraction and manipulation.

Required Skills

• 8+ years of professional experience in relevant engineering roles.
• Expert proficiency in Azure DevOps.
• Expert knowledge of Kubernetes.
• Expertise with Ansible and Terraform.
• Expert-level command of Gitlab CI/CD pipelines.
• Proficiency in Python and PySpark scripting.
• Strong ability to write and optimize SQL queries.

Key Skills

Education

Any Graduate