Description

You will manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory. This role is on-site.

Responsibilities

• Integrate and process Bloomberg market data feeds into trading and analytics platforms.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.

Required Skills

• 10+ years of experience in data engineering or production support within financial services.
• Hands-on experience with Azure Databricks, Azure Data Factory, Azure Storage, Logic Apps, and Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).
• Ability to collaborate with operations and infrastructure teams to resolve incidents.
• Experience managing batch processes and data pipelines.
• Knowledge of data ingestion workflows for market data.

Key Skills

Education

Any Graduate