Dsv4 - #1937

Open

HAOCHENYE wants to merge 7 commits into

mainfrom

Commits on Jul 20, 2026

[Feature] Add DeepSeek-V4 building blocks: hash router, sqrtsoftplus scoring, dual RoPE
HAOCHENYE
committed
[Feature] Add DeepSeek Sparse Attention (DSA): KVCompressor, Indexer, sparse-attn + varlen triton kernels
HAOCHENYE
committed
[Feature] Add Hyper-Connections decoder layer + fused HC kernels for DeepSeek-V4
HAOCHENYE
committed
[Refactor] MoE: template-method forward seams shared by DeepSeek-V4
HAOCHENYE
committed
[Feature] Add DeepSeekV4 model + Domino-EP + entry-point for DeepSeek-V4-Flash
HAOCHENYE
committed
[Config] Add ci/config/deepseek_v4_flash.py for DeepSeek-V4-Flash training
HAOCHENYE
committed
[Docs] Add DeepSeek-V4 + MTP design docs
HAOCHENYE
committed