Skip to content

Commit 37ed1ad

Browse files
VJHackggerganov
andauthored
Update src/llama-sampling.cpp
Co-authored-by: Georgi Gerganov <[email protected]>
1 parent 1c05285 commit 37ed1ad

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-sampling.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1680,7 +1680,7 @@ static void llama_sampler_top_n_sigma_apply(struct llama_sampler * smpl, llama_t
16801680
float std = sqrt(acc/cur_p->size);
16811681

16821682
//apply mask
1683-
for(size_t i = 0; i < cur_p->size; ++i){
1683+
for (size_t i = 0; i < cur_p->size; ++i) {
16841684
if (cur_p->data[i].logit < max - (ctx->n * std)) {
16851685
cur_p->data[i].logit = -INFINITY;
16861686
}

0 commit comments

Comments
 (0)