Feat/lock free server#236

Draft

orca-zhang wants to merge 13 commits intoikawrakow:mainfrom

orca-zhang:feat/lock-free-server

Commits on Feb 24, 2025

Give the user the option to override where model weights are stored
Iwan Kawrakow
committed

Commits on Feb 25, 2025

Fix ggml_nbytes() problem and cleanup
Iwan Kawrakow
committed
Add timing info to CUDA graph evaluation
Iwan Kawrakow
committed
Add more timing info
Iwan Kawrakow
committed

Commits on Feb 27, 2025

Commits on Feb 28, 2025

Commits on Mar 1, 2025

Merge branch 'ikawrakow:main' into feat/lock-free-server
orca-zhang
authored

Commits on Mar 18, 2025

Merge branch 'ikawrakow:main' into feat/lock-free-server
orca-zhang
authored

Commits on Mar 19, 2025

Merge branch 'ikawrakow:main' into feat/lock-free-server
orca-zhang
authored