Skip to content

Commit c29a4b5

Browse files
committed
refactor: update llama, ref #26
-- Penalty sampler API initalization was changed
1 parent 4b493ff commit c29a4b5

File tree

3 files changed

+2
-10
lines changed

3 files changed

+2
-10
lines changed

code/ac/llama/Sampler.cpp

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -37,15 +37,10 @@ Sampler::Sampler(Model& model, const Params& params)
3737

3838
llama_sampler_chain_add(chain,
3939
llama_sampler_init_penalties(
40-
llama_n_vocab(lmodel),
41-
llama_token_eos(lmodel),
42-
llama_token_nl(lmodel),
4340
params.repetitionPenalty.numTokens,
4441
params.repetitionPenalty.repeat,
4542
params.repetitionPenalty.freq,
46-
params.repetitionPenalty.present,
47-
params.penalizeNewline,
48-
params.ignoreEos
43+
params.repetitionPenalty.present
4944
)
5045
);
5146

code/ac/llama/Sampler.hpp

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -62,9 +62,6 @@ class AC_LLAMA_EXPORT Sampler {
6262
float threshold = 0.10f; // > 0.5 disables XTC
6363
} xtc;
6464

65-
bool penalizeNewline = false; // consider newlines as a repeatable token
66-
bool ignoreEos = false;
67-
6865
std::vector<SamplingType> samplerSequence = {
6966
SamplingType::Top_K,
7067
SamplingType::Typical_P,

llama.cpp

Submodule llama.cpp updated 196 files

0 commit comments

Comments
 (0)