Replace js-tiktoken BPE merge algorithm with faster heap based algorithm#101
Open
mikolalysenko wants to merge 3 commits into
Open
Replace js-tiktoken BPE merge algorithm with faster heap based algorithm#101mikolalysenko wants to merge 3 commits into
mikolalysenko wants to merge 3 commits into