Description

You will support efforts to perform data mitigation on large-scale datasets, including image, video, and text, to proactively mitigate risks for FAIR research teams.

Responsibilities

• Preprocess original datasets into formats consumable by mitigation pipelines.
• Run filtering processes using Integrity's pipeline.
• Implement new features across the frontend (React) and backend (PHP or Python).
• Consume filtering results to apply changes to original datasets, repackage, and re-ingest.
• Write and code logical and physical database descriptions and specify database identifiers for management systems.
• Identify optimization opportunities and improve data processing workflows.

Required Skills

• 5+ years of relevant software engineering experience.
• Proficiency in Python, PHP, and React.
• Experience building and managing data pipelines.
• Skills in data processing, cleaning, transformation, and validation.
• Experience with SQL for data management.
• Familiarity with AI tools or building tools.
• Scripting skills for automating file processing and data transfer.
• Ability to collaborate effectively with stakeholders.

Key Skills

Education

Any Graduate