[ROCm][DSv4] Make AITER sparse decode cudagraph-clean (rebased, stacked on #901) - #902

Draft

ChuanLi1101 wants to merge 8 commits into

ROCm:hexwang/dsv4_adapt_upstreamfrom

ChuanLi1101:chuali/aiter-mla-dsv4-decode-cudagraph-rebased

Commits on Apr 28, 2026

make kernel compatible with rocm platform

ganyi1996ppo
authored and
whx-sjtu
committed
7cd0918
ref supoort of dsv4
whx-sjtu
committed
66ed64f
[ROCm] Add AITER-accelerated MLA decode for DeepSeek V4 on MI355X
ChuanLi1101
committed
dfe7811
[ROCm] DSv4 AITER decode: always enable, drop env-var flag
ChuanLi1101
committed
566d4c3
[ROCm] DSv4 AITER decode: split q heads at outer level when h_q>32
ChuanLi1101
committed
e960500
[ROCm][DSv4] mxfp4.py: add missing RoutingMethodType import
ChuanLi1101
committed
8506b27
[ROCm][DSv4] Make AITER sparse decode cudagraph-clean

ChuanLi1101
authored and
ChuanLi1101
committed
b9f8234
[ROCm][DSv4] Refresh AITER work plan every step, not just on rebuild
ChuanLi1101
committed
f4778f8