Description

You will lead technology initiatives for the Trade Surveillance Data Engineering team, owning end-to-end solution design, coding, testing, and documentation.

This role is hybrid.

Responsibilities

• Design and implement large-scale ETL packages using SQL Server, SSIS, and PySpark to process data from Oracle, flat files, ISO, FTP, and NDM sources.
• Develop and maintain structured test plans, ensuring thorough documentation and code quality across all systems.
• Establish engineering standards and companywide best practices for complex technology disciplines.
• Analyze technical challenges involving multiple factors to deliver strategic business objectives.

Required Skills

• 5+ years of professional experience with Python.
• Proficiency in SQL Server and SSIS for data integration.
• Experience with PySpark for large-scale data processing.
• Working knowledge of AutoSys JIL commands or equivalent scheduling tools.
• Ability to design and implement robust ETL processes.
• Experience working within Agile methodologies using Jira.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Domain knowledge in Trade Surveillance.
• Exposure to Generative AI tools.

Key Skills

Education

Any Graduate