Skip to content

Commit

Permalink
XTC: added xtc_min parameter for minimum top tokens required
Browse files Browse the repository at this point in the history
* the original oobabooga/text-generation-webui#6335 calls for 2 minimum
* some older commits from llama.cpp I forgot earlier
* Vulcan commit ggml-org/llama.cpp#9118
* fixed wrong `xtc_probability_once` type
  • Loading branch information
MaggotHATE committed Aug 22, 2024
1 parent 79b923f commit 302e9c9
Show file tree
Hide file tree
Showing 15 changed files with 149,695 additions and 149,054 deletions.
297,567 changes: 149,041 additions & 148,526 deletions base/ggml/ggml-vulkan-shaders.cpp
873 changes: 438 additions & 435 deletions base/ggml/ggml-vulkan-shaders.hpp
149 changes: 103 additions & 46 deletions base/ggml/ggml-vulkan.cpp
24 changes: 24 additions & 0 deletions base/ggml/vulkan-shaders/acc.comp
4 changes: 4 additions & 0 deletions base/ggml/vulkan-shaders/vulkan-shaders-gen.cpp
27 changes: 17 additions & 10 deletions base/llama-addon.cpp
3 changes: 2 additions & 1 deletion base/llama-addon.h
15 changes: 15 additions & 0 deletions base/llama/llama-impl.h
43 changes: 23 additions & 20 deletions base/llama/llama-vocab.cpp
4 changes: 2 additions & 2 deletions base/llama/llama-vocab.h
33 changes: 20 additions & 13 deletions base/llama/llama.cpp
3 changes: 2 additions & 1 deletion base/sampling.cpp
1 change: 1 addition & 0 deletions base/sampling.h
1 change: 1 addition & 0 deletions include/jsonParams.h
2 changes: 2 additions & 0 deletions thread_chat.h

0 comments on commit 302e9c9

Please sign in to comment.