Repository navigation
Conversation
[Low impact] The PR appears safe to merge.
|
AlexsJones
left a comment
There was a problem hiding this comment.
Thanks for sharing these, @AythaE, vLLM AWQ numbers on a 5060 Ti are a welcome addition since there's no folder for that card yet.
Checked both files: same machine in each (Ryzen 7 3700X, 30.26 GB RAM, RTX 5060 Ti with 15.93 GB VRAM, classed DISCRETE_GPU), one model per file with three runs each and a tight min/max spread, written by llmfit 1.1.17 against schema v1. The second file (MiMo-V2.6-Distill-Qwen-9B at 30.9 tok/s) isn't in the PR description's table, but it's from the same session, so no need to change anything.
Looks good to me. Only the data-only checks ran here (no Rust test run for a data path), so I'll leave the merge to Alex.
Automated benchmark contribution from
llmfit bench --share.Submitted without the
ghCLI via the GitHub device flow.