Description

Build and maintain batch processes and data pipelines for trading and analytics platforms using Azure Databricks and Azure Data Factory.

This role is on-site.

Responsibilities

• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Integrate and process Bloomberg market data feeds (BPIPE, TSIP) and files into downstream systems.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
• Ensure data quality, completeness, and timeliness for reporting systems.

Required Skills

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands-on experience with Azure Databricks, Azure Data Factory, Azure Storage, Logic Apps, and Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).
• Proficiency in ETL pipeline development and optimization.
• Experience with Apache Spark.

Preferred Skills

• Experience with Azure Logic Apps.
• Familiarity with Azure Fabric.

Key Skills

Education

Any Graduate