[Router][Bugfix] Keep the KV-aware /tokenize fallback off the event loop - #1101

Open

David-Wu1119 wants to merge 2 commits into

vllm-project:mainfrom

David-Wu1119:fix/kvaware-tokenize-nonblocking

Commits on Sep 24, 2026

[Router][Bugfix] Keep the KV-aware /tokenize fallback off the event loop

David-Wu1119
and
claude
committed
626db7b

Commits on Sep 30, 2026

[Router] Return 503 from the KV-aware router when no endpoints are discovered

David-Wu1119
and
claude
committed
53d1045