Is beam search ready?
#7224
-
|
I see efforts to implement beam search in llama.cpp and find relevant code, but I cannot find documents about how to set the relevant parameters (e.g., num_beams). Is this feature ready? |
Beta Was this translation helpful? Give feedback.
Answered by
ggerganov
May 12, 2024
Replies: 1 comment 1 reply
-
|
There was an initial implementation (still exposed via |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
why is it wrong or is the logic correct? |
Beta Was this translation helpful? Give feedback.
Answer selected by
Sunt-ing
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
There was an initial implementation (still exposed via
llama.h), but IMO it has to be reimplemented from scratch as a standalone example