feat(runtime): add heterogeneous one-producer multi-consumer DFlash fanout - #707

Draft

heiheiha798 wants to merge 48 commits into

sgl-project:mainfrom

heiheiha798:feat/one-producer-multi-consumer-launcher

Commits on Jul 18, 2026

feat(runtime): add bounded windowed capture scheduling
heiheiha798
committed
9a2fde3
perf(dflash): combine key value projection inputs
heiheiha798
committed
6e700ce
perf(dflash): add fused frozen-head cross entropy
heiheiha798
committed
4924765
perf(training): add fused AdamW backend
heiheiha798
committed
89707b6
perf(benchmarks): add consumer critical path measurements
heiheiha798
committed
f5c69d9
feat(runtime): integrate windowed capture services
heiheiha798
committed
d6b9857
feat: wire local capture into windowed fanout
heiheiha798
committed
4ce5d01
perf(dflash): add configurable fused draft kernels
heiheiha798
committed
33f9708
perf(dflash): compact zero-weight frozen CE rows
heiheiha798
committed
d3b1743
perf(dflash): expose FlexAttention kernel options
heiheiha798
committed
bd46b9f
perf(runtime): coalesce windowed producer capture batches
heiheiha798
committed
989ec29
fix(capture): harden server and Mooncake lifecycle
heiheiha798
committed
64eadc0
fix(runtime): preserve durable Mooncake cleanup after restack
heiheiha798
committed
2dff16f
fix(disagg): preserve unified capture retry lifecycle
heiheiha798
committed
4fac7bd
feat(observability): add role-aware NVML telemetry
heiheiha798
committed
de1bb00
feat(runtime): package production DFlash fanout
heiheiha798
committed
8607cb5
feat(runtime): expose consumer input pipeline timings
heiheiha798
committed
6a9331f
feat(runtime): report window demand wait metrics
heiheiha798
committed
9b1a4f5
perf(runtime): roll prefetch through capture windows
heiheiha798
committed
b90ec53
fix(observability): allow managed worker descendants
heiheiha798
committed
37ca292
fix(benchmarks): run against the active checkout
heiheiha798
committed
b7ca5e5
docs(benchmarks): show single-GPU invocation
heiheiha798
committed
938f1e9
fix(dflash): wire optimized backends through unified runtime
heiheiha798
committed
60ad0d3
fix(benchmarks): use unified algorithm and loader APIs
heiheiha798
committed
364ca26
fix(runtime): keep fanout behind canonical package surfaces
heiheiha798
committed
cb313c2
style: satisfy pre-commit after restack
heiheiha798
committed
82fb49e
fix(capture): migrate prior server patch revisions
heiheiha798
committed
1602eb4
fix(fanout): honor managed Mooncake endpoints
heiheiha798
committed
57ed167
fix(runtime): align windowed ACK ownership
heiheiha798
committed
909bf78
fix(ci): pass capture patch interpreter
heiheiha798
committed
f85c694
fix(ci): align live capture gate ownership
heiheiha798
committed
b7b0825
fix(observability): harden GPU telemetry evidence
heiheiha798
committed
d90a30d
fix(runtime): harden window recovery and child cleanup
heiheiha798
committed
02103f8
fix(mooncake): make deferred cleanup complete and bounded
heiheiha798
committed
535998e
fix(config): validate fanout runtime boundaries
heiheiha798
committed
937e8b0
test(dflash): cover real kernels and resume boundaries
heiheiha798
committed
c325a93
test(runtime): exercise legacy installer upgrades
heiheiha798
committed
4e30abd
style(ci): satisfy server capture gate isort
heiheiha798
committed
7371639
refactor: narrow fanout change to runtime scope
heiheiha798
committed
27f34fe
feat(disagg): use canonical windowed fanout launch
heiheiha798
committed
9c226c7
refactor(disagg): split windowed capture responsibilities
heiheiha798
committed
283f2d3
fix(disagg): preserve physical generations across recapture
heiheiha798
committed
6ebcbb2
refactor(sglang): collapse capture patch migration
heiheiha798
committed
3f274b9
docs(disagg): add canonical heterogeneous fanout example
heiheiha798
committed
61455f9

Commits on Jul 19, 2026

test(ci): align fanout fixtures with current contracts
heiheiha798
committed
423dae9
fix(mooncake): enforce the raw tensor wire path
heiheiha798
committed
cd9ce32

Commits on Jul 20, 2026