Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM
Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark.
In brief
- What: Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM
- When: November 7, 2026 at 11:16
- Source: MarkTechPost (media)
- Topic: Models
Prepared by Ilya Tarasov’s Tarasov Code newsroom based on a report by MarkTechPost.
