Description

Manage and optimize batch processes and data pipelines in Azure Databricks and Azure Data Factory for trading and analytics platforms.

This role is on-site.

Responsibilities

• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Integrate and process Bloomberg market data feeds (BPIPE, TSIP) and files into downstream systems.
• Monitor, troubleshoot, and resolve data quality, completeness, and timeliness issues for trading applications.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Collaborate with operations and infrastructure teams to resolve incidents and enhance data workflows.

Required Skills

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands-on experience with Azure Databricks, Azure Data Factory, Azure Storage, Logic Apps, and Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).

Preferred Skills

• Experience integrating market data feeds into high-frequency trading or analytics platforms.

Key Skills

Education

Any Graduate