Skip to content

Releases: mmoskal/llama.cpp

b4625

04 Feb 20:21
5598f47

Choose a tag to compare

server : remove CPPHTTPLIB_NO_EXCEPTIONS define (#11622)

This commit removes the CPPHTTPLIB_NO_EXCEPTIONS define from the server
code.

The motivation for this is that when using a debug build the server
would crash when an exception was throws and terminate the server
process, as it was unhandled. When CPPHTTPLIB_NO_EXCEPTIONS is set
cpp_httplib will not call the exception handler, which would normally
return a 500 error to the client. This caused tests to fail when using
a debug build.

Fixes: https://github.com/ggerganov/llama.cpp/issues/11613

b4607

31 Jan 20:01
aa6fb13

Choose a tag to compare

`ci`: use sccache on windows instead of ccache (#11545)

* Use sccache on ci for windows

* Detect sccache in cmake

b4531

22 Jan 23:06
6152129

Choose a tag to compare

main : update README documentation for batch size (#11353)

* main : update README documentation for batch size

* fix formatting

* minor

b4277

07 Dec 04:27
c5ede38

Choose a tag to compare

convert : add custom attention mapping

b4042

07 Nov 17:46
5107e8c

Choose a tag to compare

DRY: Fixes clone functionality (#10192)