Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 91.3k 21.9k

2. guoqingbao/xinfer guoqingbao/xinfer Public

   Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

   Rust 315 43

3. kernel_benchmarks kernel_benchmarks Public

   Python

4. t-sim t-sim Public

   Python