Platform DesignDec 18, 20248 min read
Building Kortex: A Kubernetes-Native AI Inference Gateway
A technical deep dive into designing Kortex, a multi-provider inference gateway with intelligent routing, circuit breakers, OpenTelemetry tracing, and cost tracking.
GoKubernetesKubebuilderKServe
Read more