Pinned Loading

1. mlc-llm mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 22.8k 2.1k

2. web-llm web-llm Public

   High-performance In-browser LLM Inference Engine

   TypeScript 18.2k 1.3k

3. mlc-zh mlc-zh Public

   Python 631 69

4. mlc-en mlc-en Public

   Python 459 61

5. web-llm-chat web-llm-chat Public

   Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

   TypeScript 1k 221

6. xgrammar xgrammar Public

   Fast, Flexible and Portable Structured Generation

   C++ 1.7k 153