Nawinder Pawar
Kubernetes
26 Sep 2026
How llm-d's Endpoint Picker knows which replica holds your prefix