Description

You will design, build, and secure scalable Gen AI platform capabilities, including LLM pipelines, agentic workflows, and RAG architectures, while managing costs, governance, and user enablement.

This role is hybrid.

Responsibilities

• Design and maintain scalable Gen AI platform components using Python and AWS-native tooling, including LLM gateways, agentic frameworks, and Graph/RAG architectures.
• Implement technical security, risk, and compliance controls (IAM, guardrails, data-access, logging) in collaboration with InfoSec, Legal, and Compliance teams.
• Automate platform provisioning, policy enforcement, and cost guardrails using Infrastructure as Code, ensuring adherence to DevSecOps protocols.
• Monitor AI platform costs and usage; build dashboards and anomaly detection systems to manage token budgets, quotas, and rate limits.
• Provide user support, create runbooks, and troubleshoot technical issues related to agents, MCP servers, and API integrations.

Required Skills

• 6+ years of progressive engineering experience, including 1-2+ years in AI platform, cloud platform, or emerging-tech enablement.
• Hands-on Python programming (NumPy, Pandas, Boto3) for automation and platform services.
• Deep experience with Gen AI models (GPT, Claude, Gemini, LLaMA), prompt engineering, and agentic AI patterns.
• Proficiency with AWS services (EKS, Lambda, Fargate, Bedrock, Glue, Athena) and cloud-native architecture.
• Infrastructure as Code expertise using Terraform, Puppet, and Docker for containerized deployments.
• Experience with Vector/Graph databases (Weaviate, Milvus, PGVector, Neo4j, Neptune) and query optimization.
• Knowledge of automated testing and evaluation frameworks (Ragas, Playwright, Selenium, Zephyr).
• Proven track record implementing technical controls for InfoSec, Risk, and Compliance in regulated environments.

Preferred Skills

• Experience with MCP (Model Context Protocol) servers and integrations.
• Background in responsible AI standards and enterprise governance.

Key Skills

Education

Any Graduate