Description

Lead the development of the enterprise-scale AI Gateway and Portal, ensuring scalable, secure access to Large Language Models across Azure and Google Cloud Platform.

Responsibilities

• Develop and maintain backend services primarily in Python, including APIs and proxy/gateway logic.
• Manage cloud infrastructure automation using Terraform on Azure and GCP.
• Deploy and optimize applications in Kubernetes (AKS) using Helm, leveraging GitHub Actions for CI/CD pipelines.
• Ensure system observability and reliability using Datadog or Dynatrace, meeting strict SLAs and leading incident management.
• Collaborate with cross-functional teams to integrate AI model APIs (Azure OpenAI, Google VertexAI) and drive technical strategy.

Required Skills

• 10+ years of software engineering experience, with 5+ years in public cloud technologies (Azure or GCP).
• 5+ years of experience with container orchestration, specifically Docker, Kubernetes, and Helm.
• 3+ years of hands-on experience with Infrastructure as Code using Terraform.
• Strong proficiency in Python for backend service development.
• Experience building and maintaining CI/CD pipelines using GitHub Actions.
• Familiarity with observability tools such as Datadog or Dynatrace.
• Bachelor’s degree in a technology-related discipline or equivalent work experience.
• Ability to manage large-scale technical projects under tight deadlines.

Preferred Skills

• Experience developing AI-powered features, including familiarity with LLMs, Agents, and Model Context Protocol (MCP).
• Proven track record building API Gateways or proxy services.

Key Skills

Education

Any Graduate