Description

You will design and manage scalable data pipelines and architectures within a capital markets or hedge fund environment.

Responsibilities

• Build and manage scalable data pipelines to collect, process, and store large volumes of data.
• Develop and maintain ETL processes to ensure accurate data movement across systems.
• Design, implement, and optimize database schemas and data warehouse structures.
• Integrate data from multiple sources while ensuring consistency, quality, and reliability.
• Monitor data pipelines and systems to troubleshoot and resolve performance or reliability issues.

Required Skills

• 10+ years of experience with SQL and Python.
• 5+ years of experience with Azure cloud services, specifically Azure Databricks, Azure Data Factory (ADF), Azure SQL Server, and Azure Data Lake Storage (ADLS).
• 5+ years of experience with GIT and deploying code via CI/CD pipelines.
• Hands-on experience with Azure Key Vault, Azure Functions, and Logic Apps.
• Direct experience working in Capital Markets, Trading, or Hedge Funds.
• Proven ability to optimize data processing and storage for efficient resource utilization.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience with .NET.
• Microsoft Certified: Azure Data Engineer Associate.
• Databricks Certified Data Engineer Associate or Professional.

Key Skills

Education

Any Gradute