Skip to content

Allow users to supply their own BPE tokeniser#83

Open
xd009642 wants to merge 1 commit intozurawiki:mainfrom xd009642:perf/supply-bpe-to-num-tokens
+108-1

Commits

Commits on Aug 14, 2024