Description

You will design and maintain data pipelines using Python and PySpark to transform structured and unstructured data for quantitative analysis.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using Python and PySpark.
• Transform structured and unstructured data for financial engineering and quantitative analysis.
• Integrate Large Language Models (LLMs) into data processing workflows.
• Develop automation tools for testing, deployment, and software development.
• Conduct code reviews and enforce coding standards.

Required Skills

• 5+ years of experience as a Data Engineer or similar role.
• Strong Python programming skills for data engineering and operational support.
• Solid SQL skills for querying and manipulating structured data.
• Experience with PySpark for data processing.
• Knowledge of Large Language Models (LLM) and their integration with data pipelines.
• Familiarity with AWS for deployment and scaling.
• Proficiency with Git and scripting.

Preferred Skills

• Experience with C++.

Key Skills

Education

Any Graduate