Skip to content

Commit 302e9c9

Browse files
MaggotHATEMaggotHATE
committed
XTC: added xtc_min parameter for minimum top tokens required
* the original oobabooga/text-generation-webui#6335 calls for 2 minimum * some older commits from llama.cpp I forgot earlier * Vulcan commit ggml-org/llama.cpp#9118 * fixed wrong `xtc_probability_once` type
1 parent 79b923f commit 302e9c9

File tree

15 files changed

+149695
-149054
lines changed

15 files changed

+149695
-149054
lines changed

‎base/ggml/ggml-vulkan-shaders.cpp‎

Lines changed: 149041 additions & 148526 deletions
Original file line numberDiff line numberDiff line change

‎base/ggml/ggml-vulkan-shaders.hpp‎

Lines changed: 438 additions & 435 deletions
Original file line numberDiff line numberDiff line change

‎base/ggml/ggml-vulkan.cpp‎

Lines changed: 103 additions & 46 deletions
Original file line numberDiff line numberDiff line change

‎base/ggml/vulkan-shaders/acc.comp‎

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change

‎base/ggml/vulkan-shaders/vulkan-shaders-gen.cpp‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change

‎base/llama-addon.cpp‎

Lines changed: 17 additions & 10 deletions
Original file line numberDiff line numberDiff line change

‎base/llama-addon.h‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change

‎base/llama/llama-impl.h‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change

‎base/llama/llama-vocab.cpp‎

Lines changed: 23 additions & 20 deletions
Original file line numberDiff line numberDiff line change

‎base/llama/llama-vocab.h‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change

0 commit comments

Comments
 (0)