[Bugfix][Router] Use supplied timestamp for avg_latency and drop completed request maps - #1080

[Bugfix][Router] Use supplied timestamp for avg_latency and drop completed request maps#1080

nisaral wants to merge 2 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

nisaral:bugfix/request-stats-latency-timestampnisaral/production-stack:bugfix/request-stats-latency-timestampCopy head branch name to clipboard