Description

You will design and implement enterprise AI governance and runtime security frameworks for Generative AI and LLM platforms.

This role is hybrid.

Responsibilities

• Develop and manage AI guardrails, compliance controls, prompt filtering, and runtime security solutions.
• Implement Model Armor or similar AI security tooling for secure inference and request/response inspection.
• Utilize Arize AI for telemetry, inference tracing, and model behavior analysis.
• Manage Kubernetes-based AI infrastructure and Terraform deployments across Azure and GCP cloud landing zones.
• Troubleshoot runtime bottlenecks, rate limiting, token throughput issues, and API gateway failures.

Required Skills

• 5+ years of experience with Generative AI, GenAI platforms, and LLM infrastructure.
• Expertise in AI security, AI guardrails, and compliance frameworks.
• Strong Kubernetes administration and troubleshooting skills.
• Experience with Terraform and Infrastructure as Code (IaC).
• Strong cloud infrastructure experience with Azure and/or GCP.
• Experience with APIs, API Gateways, and distributed AI serving architectures.

Preferred Skills

• Experience with distributed inference systems and LLM serving platforms.
• Exposure to responsible AI and enterprise AI governance frameworks.

Key Skills

Education

Bachelor's degree