[Router][Bugfix] KV-aware routing: tokenize chat-completions bodies through the chat template - #1045

[Router][Bugfix] KV-aware routing: tokenize chat-completions bodies through the chat template#1045

tyler2cr wants to merge 9 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

tyler2cr:router-kvaware-chat-completionstyler2cr/production-stack:router-kvaware-chat-completionsCopy head branch name to clipboard