We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 599a2d7 commit bf30513Copy full SHA for bf30513
models/mistral.cpp
@@ -863,7 +863,7 @@ Always prioritize using tools to provide the most accurate and helpful response.
863
864
static float get_llama_4_attn_scale(int pos, float beta, int max_position_embeddings)
865
{
866
- return 1.0f + beta * std::logf(1.0f + std::floorf((float)pos / max_position_embeddings));
+ return 1.0f + beta * logf(1.0f + floorf((float)pos / max_position_embeddings));
867
}
868
869
#define MAX_PROJECTED_TOKENS 2048
0 commit comments