Skip to content

Skip token type ids in Hugging Face backend - #2619

Open
Marchematics wants to merge 3 commits into
open-compass:mainfrom
Marchematics:contrib/hf-no-token-type-ids
Open

Skip token type ids in Hugging Face backend#2619
Marchematics wants to merge 3 commits into
open-compass:mainfrom
Marchematics:contrib/hf-no-token-type-ids

Fix tokenizer inputs for Hugging Face generation

4321ca0
Select commit
Loading
Failed to load commit list.