Description

You will build and maintain the data platform for SMBC Capital Markets and Nikko Securities, starting with reference data systems for securities and pricing.

This role is on-site.

Responsibilities

• Develop full-stack Python and PySpark solutions for data engineering pipelines.
• Implement and manage Azure cloud services, including Data Factory, Lake Gen 2, and Data Fabric.
• Build APIs using FastAPI and manage API Gateway configurations.
• Execute ETL/ELT processes and optimize SQL queries for RDMS or NoSQL databases.
• Maintain CI/CD pipelines using Jenkins and Git within DevOps workflows.

Required Skills

• 5+ years of experience as a Data Engineer.
• Strong proficiency in Python and PySpark.
• Hands-on experience with Azure Cloud services and Databricks.
• Experience implementing Azure Data Factory, Azure Lake Gen 2, and Azure Data Fabric.
• Proficiency in SQL with RDMS or NoSQL databases.
• Experience developing APIs using FastAPI or similar frameworks.
• Familiarity with DevOps lifecycle, Git, Jenkins, and CI/CD processes.

Preferred Skills

• Experience in the financial services industry.
• Knowledge of financial instruments, asset classes, and market data.

Key Skills

Education

Bachelor's degree