Popular repositories Loading

1. inference inference Public

   Forked from mlcommons/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python

2. vllm-gaudi vllm-gaudi Public

   Forked from vllm-project/vllm-gaudi

   Community maintained hardware plugin for vLLM on Intel Gaudi

   Python

3. generative-recommenders generative-recommenders Public

   Forked from meta-recsys/generative-recommenders

   Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python