Skip to content

[Bugfix][Router] Use supplied timestamp for avg_latency and drop completed request maps - #1080

Open
nisaral wants to merge 2 commits into
vllm-project:mainfrom
nisaral:bugfix/request-stats-latency-timestamp
Open

[Bugfix][Router] Use supplied timestamp for avg_latency and drop completed request maps#1080
nisaral wants to merge 2 commits into
vllm-project:mainfrom
nisaral:bugfix/request-stats-latency-timestamp

fix(router): record avg_decoding_length from first-token to completion

1da882e
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 8, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO