Add hot-swappable EXL3 MSRT expert cartridges with TP support - #299

Open

malaiwah wants to merge 7 commits into

local-inference-lab:dev/gilded-gnosisfrom

malaiwah:feat/exl3-lora-cartridge-clean

Commits on Aug 12, 2026

feat(exl3): LoRA cartridge support for MSRT additive quantization

malaiwah
and
GLM-5.2
committed
456227c
fix(exl3): harden CUDA graph cartridge hot-swap

malaiwah
and
codex
committed
d057cbc

Commits on Aug 13, 2026

feat(exl3): make cartridge runtime zero-cost when inactive

malaiwah
and
codex
committed
e161019
Run EXL3 cartridges from packed trellises
malaiwah
committed
4abd745
feat(exl3): drop redundant cartridge suh/svh, add hot-swap HTTP endpoints
malaiwah
committed
1b7926f
perf(exl3): restore few-active-expert grouping, cut load time, skip input copy
malaiwah
committed
7e48079
feat(exl3): enforce versioned cartridge compatibility

malaiwah
and
codex
committed
a7b107f