← Back to jobs

Qualitest Logo
AI Data Services Solution Architect

Qualitest

 

Santa Clara, CA, USA

Posted On: 15+ days ago
Experience: 6+ years
Availability: Remote
Openings: 1
Category: Solution Architect
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You design data-focused AI solutions for customers, bridging client needs with technical execution.

This role is remote.

Responsibilities

  • Lead customer discovery sessions covering data sourcing, annotation, evaluation, and Human-in-the-Loop processes.
  • Design end-to-end solution architectures, including data pipelines, annotation workflows, QA, and evaluation frameworks.
  • Define data governance needs, covering provenance, labeling guidelines, PII handling, and compliance.
  • Develop HITL workflows, including task routing, reviewer processes, and quality controls.
  • Create evaluation approaches for LLMs/ML models, focusing on grounding accuracy, hallucination checks, and safety.

Required Skills

  • 6+ years in solution architecture, data engineering, ML, or a related technical role with client-facing experience.
  • Expertise in data pipelines using Spark, Databricks, ADF, SQL, or Python.
  • Hands-on knowledge of Annotation/HITL platforms (e.g., Label Studio, SageMaker Ground Truth).
  • Solid understanding of LLMs and ML evaluation concepts and safety best practices.
  • Ability to execute API Integrations for data ingestion and tool connectivity.
  • Proficiency with modern front-end frameworks like React or Next.js.
  • Strong ability to communicate complex topics to both technical and business stakeholders.
  • Solid documentation and diagramming skills (Visio, Lucidchart, Miro).

Preferred Skills

  • Familiarity with Azure OpenAI, Vertex AI, or AWS Bedrock/SageMaker.
  • Experience integrating CRM, support systems, or enterprise content repositories.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs