Description

Key Responsibilities

• Develop and maintain Python components for text preprocessing, model invocation, prompt management, structured output validation, and coding workflows.
• Implement controlled, versioned changes to prompts, model configurations, dictionaries, rules, and supporting code.
• Build pilots that combine LLMs, fuzzy matching, and dictionary-based approaches adapted to survey taxonomies and requirements.
• Design and write unit, integration, regression, negative, and edge-case tests; collaborate with evaluation teams to compare results against baselines.
• Investigate and reproduce production issues across code, data, prompts, and model behavior; implement verified corrections and support rollbacks when required.
• Partner with MLOps to package, deploy, verify, and document releases within approved AWS environments.
• Participate in code reviews, SME sessions, and produce clear technical documentation and reproducible examples for handoff.

Qualifications

• Bachelor's degree in computer science, engineering, data science, or equivalent relevant professional experience.
• 8+ years in software or ML engineering with at least 3 years building NLP or ML applications and hands-on experience integrating LLMs into production workflows.
• Strong Python development skills; experience with data processing, APIs, automated testing practices, Git, and maintainable software design.
• Experience with text classification, prompt design, structured model outputs, and measuring the impact of implementation changes on model performance.
• Proven experience deploying or supporting applications in AWS and troubleshooting production issues while collaborating with cross-functional teams.

Preferred

• Experience with fuzzy matching, dictionary-based coding, and handling survey text or industry/occupation classification.
• Familiarity with ML frameworks such as scikit-learn, PyTorch, or Hugging Face and handling sensitive data in controlled federal environments.
• Ability to obtain and maintain required federal credentials (e.g., Special Sworn Status, PIV) and support core business hours and coordinated processing runs as needed

Key Skills

Education

Bachelor's degree