Description

You will design and maintain high-performance data architectures and pipelines.

This role is on-site.

Responsibilities

• Design and implement ETL pipelines using Azure Data Factory and Databricks.
• Write Python, Spark, and SQL code adhering to security, auditing, and performance standards.
• Execute unit testing using automation tools to ensure code quality.
• Collaborate with the system test team to integrate tests into the overall test plan.
• Manage multiple tasks and adapt to changing project requirements.

Required Skills

• 10+ years of professional data engineering experience.
• Proficiency in Python.
• Expertise in Spark.
• Advanced SQL skills.
• Experience with Azure Data Factory.
• Experience with Databricks.
• Ability to meet strict local IT guidelines, security, and auditing policies.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate