Pinned Loading

1. inference inference Public

   Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-re…

   Python 9.6k 866

2. xagent xagent Public

   Build personal agents and enterprise AI workforces that plan, delegate, use tools, and deliver real work — without brittle workflows.

   Python 301 64

3. xrouter-llm xrouter-llm Public

   A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and +1.9 pts completion on our tested dataset.

   Python 39 2

4. xllamacpp xllamacpp Public

   Forked from shakfu/cyllama

   xllamacpp - a Python wrapper of llama.cpp

   Python 87 14

5. inference-client inference-client Public

   Python 9 10

6. xoscar xoscar Public

   Python actor framework for heterogeneous computing.

   Python 174 32