Code

feat: add Phi-1.5/Phi-2 tokenizer#9361

Code

Merged

ggerganov merged 3 commits intoggml-org:masterggml-org/llama.cpp:masterfrom daminho:masterdaminho/llama.cpp:masterCopy head branch name to clipboardSep 12, 2024

+4

Commits

Commits on Sep 7, 2024

• add phi2 tokenizer

  daminho

  committed
  04c9c9d

  Copy full SHA for 04c9c9d

Commits on Sep 8, 2024

• add phi name to convert_hf_to_gguf_update.py

  daminho

  committed
  87d8636

  Copy full SHA for 87d8636

Commits on Sep 9, 2024

• make tokenizer_pre consistent; llama.cpp work

  daminho

  committed
  195a062

  Copy full SHA for 195a062