Description

• The overall goal of this assignment is to deliver a functional and impactful workflow to aid research scientists across the NST division with data management, including, but not limited to:
• Identifying the location of data and the methodology to determine which data is to be managed through the workflow
• Filtering, sanitizing, normalizing and/or otherwise preparing the data for storage/sharing
• Packaging the data with AI-enabling metadata into an HDF5 format that can be used for long-term storage
• Creating a mechanism to migrate and inventory data for easy retrieval and/or sharing
• Building an interface/workflow that is accessible and easy to use by the research staff
•  Develop documentation of solutions
• Construct all components, artifacts, etc. using acceptable tools and techniques, good coding practices and accessible documentation

Tasks and Delivery

• Three projects have been identified that require data manipulation, sanitization, orchestration and automation.
• During the first 2-3 weeks, engagements with the scientific domain experts will provide details on understanding their datasets, locations and desired outcomes.
• Once the details have been identified by the domain scientists, work will begin through an iterative development process to create a compatible workflow, using existing or new tools to achieve the desired outcomes.
• All tools, software and related materials will require compliance with local cybersecurity and IT standards as well as documentation of operation.
• Development under revision control is required.
• Delivery to the domain scientists of an MVP within the first 90-days of the project is expected. The MVP need not address all of the key deliverable outcomes but must demonstrate the core of the workflow desired.
• Further refinement, refactoring and feature addition is expected beyond the 90-day window.
• Once the domain scientists have accepted the solution, the candidate will be assigned a new set of domain experts and a new workflow to create. It is expected that each contractor will have no fewer than two active development tasks.

Required Background, Knowledge, Skills and Abilities
Knowledge/Skill/Ability:

• A strong working understanding of AI and LLMs
• Ability to develop efficient prompts and structured workflows with AI integration
• Familiarity with AI workflow orchestrators (e.x. Dify), relational databases (e.x. MySql/MariaDB, Oracle, etc.)
• Working knowledge of relevant programming/scripting languages (e.x. python) for automating tasks
• Working knowledge of revision control systems (e.x. Git), CI/CD pipelines as implemented in services like GitLab/GitHub for testing and deploying solution changes automatically
•  Familiarity with RESTful web services
• Strong skills in Linux (Debian and RHEL) CLI administration, development and general use
• Familiarity with GUI development, either through web or Python applications
• Strong written and oral communication skills, providing the ability to develop requirements for tasks through interactions with technical experts in the field

Background

• Associate or bachelor’s degree in computer science, information technology, system administration, or a closely related field, or equivalent experience required
• 2 or more years of software development and/or system administration

Key Skills

Education

Bachelor's degree