Description

You will own the design, development, and maintenance of critical data pipelines for market data ingestion and analytics.

This role is on-site.

Responsibilities

• Manage and support batch processes and data pipelines using Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds (BPIPE, TSIP, SFTP, B-Quant) into analytics platforms.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Monitor, troubleshoot, and resolve data and system issues related to market data ingestion.
• Ensure data quality, completeness, and timeliness for downstream reporting systems.

Required Skills

• 10+ years of experience in data engineering or production support within financial services.
• Hands-on experience with Azure Databricks, Azure Data Factory, Azure Storage, Logic Apps, and Fabric.
• Strong proficiency in Python and SQL programming.
• Experience handling Bloomberg data feeds (BPIPE, TSIP, SFTP, B-Quant).
• Familiarity with Git, CI/CD pipelines, and Azure DevOps.
• Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling.
• Experience with FTP/SFTP file transfers and automation.
• Solid understanding of market data concepts and financial instruments.

Preferred Skills

• Experience with Power BI or other visualization tools.
• Familiarity with Kafka, Event Hubs, or real-time streaming architectures.

Key Skills

Education

Bachelor's degree