Description

You will build and maintain data pipelines using Azure and Databricks, owning the full lifecycle from development to post-production support.

This role is on-site.

Responsibilities

• Write and optimize complex PySpark and Python code for data transformation and quality within timeboxed periods.
• Debug and resolve technical issues and post-production defects independently.
• Collaborate with stakeholders to translate requirements into robust technical solutions.
• Manage CI/CD pipelines using Jenkins and GitHub.

Required Skills

• 8+ years of experience in data engineering roles.
• Proficiency in Azure, Databricks, PySpark, Python, SQL, and SparkSQL.
• Experience with CI/CD tools including Jenkins and GitHub.
• Familiarity with Dynatrace for monitoring and debugging.

Preferred Skills

• Experience with Java, Kafka, Cassandra, Microservices, API development, Flink, ZeroMQ, or Protocol Buffers.
• Functional background in Retail Banking, Capital Markets, or Securities Processing.

Key Skills

Education

Any Graduate