Nawinder Pawar
Llm-D-Router
26 Sep 2026
How llm-d's Endpoint Picker knows which replica holds your prefix