Description

You will build and optimize data pipelines for trade lifecycle processing, market data ingestion, and risk analytics.

Responsibilities

• Build and optimize Spark and Databricks pipelines for trade lifecycle processing, market data ingestion, and risk analytics.
• Develop Java-based microservices for trade booking, validation, and workflow management.
• Implement Structured Streaming pipelines for real-time processing of trades, quotes, orders, and market data.
• Design and maintain Databricks Lakehouse architecture (Bronze, Silver, Gold layers) for required datasets.
• Deploy applications and pipelines in cloud environments (Azure/AWS) using CI/CD pipelines.

Required Skills

• 8+ years of experience in data engineering for financial or capital markets systems.
• Strong experience in Core Java and Advanced Java concepts.
• Hands-on experience with Apache Spark and Spark Structured Streaming.
• Experience working with Databricks and Delta Lake architecture.
• Experience building microservices using Spring Framework / Spring Boot.
• Experience with CI/CD tools such as Jenkins, Azure DevOps, or GitHub.
• Experience working with cloud platforms (Azure or AWS).
• Strong knowledge of market data processing and trade lifecycle systems.

Key Skills

Education

Any Gradute