Description

Design and build scalable ETL/ELT pipelines for Counterparty Credit Risk platforms using Python, Databricks, and Azure services.

This role is on-site.

Responsibilities

• Develop and optimize data pipelines integrating trade, collateral, and market data for enterprise risk analytics.
• Implement data quality, reconciliation, and monitoring frameworks within Azure Data Lake and Snowflake.
• Manage workflow orchestration and complex DAGs using Airflow or Astronomer.
• Drive production support, root cause analysis, and continuous improvement for risk platforms.
• Partner with Risk Analytics and Technology teams to deliver scalable CCR solutions.

Required Skills

• 10+ years of Python development and advanced SQL experience.
• 3+ years of hands-on experience with Databricks and PySpark.
• Strong proficiency with Azure Data Factory (ADF), Azure Data Lake, and Snowflake.
• Experience with Apache Kafka and Spark for data ingestion and processing.
• Familiarity with CI/CD tools including Jenkins, GitLab CI, and Azure DevOps.
• Knowledge of Data Warehousing, Data Lakes, and Medallion Architecture.
• Experience with Power BI for data visualization and reporting.
• Understanding of Counterparty Credit Risk (CCR) concepts such as EPE, PFE, and EAD calculations.

Preferred Skills

• Direct experience in Financial Services or Investment Banking.
• Expertise in Unity Catalog and Azure Data Governance.
• Agile development methodology and stakeholder management skills.

Key Skills

Education

Any Gradute