Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
Fast API‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and Open API docs.
Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
IAC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.
Work experience desired
Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.