Skip to content

feat: add ICU split tokenizer variant#7474

Merged
Xuanwo merged 1 commit into
mainfrom
xuanwo/oss-1274-icu-split-controls
Jun 25, 2026
Merged

feat: add ICU split tokenizer variant#7474
Xuanwo merged 1 commit into
mainfrom
xuanwo/oss-1274-icu-split-controls

Commits

Commits on Jun 25, 2026