Description

Lead the development of the enterprise-scale AI Gateway and Portal, ensuring scalable and secure access to Large Language Models across Azure and Google Cloud Platform.

This role is remote.

Responsibilities

• Develop and maintain backend services in Python, including APIs and proxy/gateway logic.
• Manage cloud infrastructure automation using Terraform on Azure and GCP.
• Deploy and optimize applications in Kubernetes (AKS) using Helm and GitHub Actions for CI/CD.
• Ensure system observability and reliability using Datadog or Dynatrace, meeting strict SLAs and leading incident management.
• Collaborate with cross-functional teams to integrate AI model APIs (Azure OpenAI, Google VertexAI) and drive technical strategy.

Required Skills

• 10+ years of software engineering experience.
• 5+ years in public cloud technologies (Azure or GCP).
• 5+ years with container orchestration: Docker, Kubernetes, and Helm.
• 3+ years of hands-on Infrastructure as Code experience using Terraform.
• Strong proficiency in Python for backend service development.
• Experience building and maintaining CI/CD pipelines using GitHub Actions.
• Familiarity with observability tools such as Datadog or Dynatrace.
• Bachelor’s degree in a technology-related discipline or equivalent work experience.

Preferred Skills

• Experience developing AI-powered features, including LLMs, Agents, and Model Context Protocol (MCP).
• Proven track record building API Gateways or proxy services.

Key Skills

Education

Any Graduate