← Back to jobs

Quantum Technologies LLC Logo
Data Engineer - Databricks

Quantum Technologies LLC

 

New York, NY, USA

Posted On: Just posted
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Manage and optimize batch data pipelines and trading analytics workflows using Azure Databricks and Azure Data Factory.

This role is on-site.

Responsibilities

  • Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL to support trading and reporting systems.
  • Integrate and process Bloomberg market data feeds (BPIPE, TSIP) and external vendor files into analytics platforms.
  • Manage and troubleshoot data ingestion issues, ensuring data quality, completeness, and timeliness for downstream applications.
  • Orchestrate data workflows using Azure Data Factory, Azure Storage, Logic Apps, and Fabric.
  • Collaborate with operations and infrastructure teams to resolve incidents and enhance data workflows.

Required Skills

  • 10+ years of experience in data engineering or production support within financial services or trading environments.
  • Strong proficiency in Python and SQL programming.
  • Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage.
  • Experience with Spark for distributed data processing.
  • Knowledge of Azure Logic Apps and Fabric.
  • Experience integrating Bloomberg data feeds (BPIPE, TSIP, SFTP).
  • Ability to manage FTP/SFTP file transfers between internal systems and external vendors.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs