Misc. bug: rpc-server crash without cache #13185
Description
Name and Version
# ./llama-cli --version
version: 5218 (00e3e5a1)
built with cc (Debian 12.2.0-14) 12.2.0 for x86_64-linux-gnu
Operating systems
Linux
Which llama.cpp modules do you know to be affected?
No response
Command line
Problem description & steps to reproduce
If rpc-server is started as a background process and no cache is specified, it fails.
root@debian12-dev:~# systemctl status lxllamad.service
● lxllamad.service - Lxllamad service for distributed inference
Loaded: loaded (/lib/systemd/system/lxllamad.service; enabled; preset: enabled)
Active: active (running) since Tue 2025-04-29 10:00:22 EDT; 2s ago
Main PID: 54469 (lxllamad)
Tasks: 4 (limit: 9442)
Memory: 3.0M
CPU: 14ms
CGroup: /system.slice/lxllamad.service
└─54469 /opt/lxllama/lxllamad
Apr 29 10:00:22 debian12-dev systemd[1]: Started lxllamad.service - Lxllamad service for distributed inference.
Apr 29 10:00:22 debian12-dev lxllamad[54491]: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Apr 29 10:00:22 debian12-dev lxllamad[54491]: WARNING: Host ('0.0.0.0') is != '127.0.0.1'
Apr 29 10:00:22 debian12-dev lxllamad[54491]: Never expose the RPC server to an open network!
Apr 29 10:00:22 debian12-dev lxllamad[54491]: This is an experimental feature and is not secure!
Apr 29 10:00:22 debian12-dev lxllamad[54491]: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Apr 29 10:00:22 debian12-dev lxllamad[54491]: create_backend: using CPU backend
root@debian12-dev:~# ps -efl | grep rpc-server
0 Z root 54491 54469 0 80 0 - 0 - 10:00 ? 00:00:00 [rpc-server] <defunct>
0 S root 54495 1036 0 80 0 - 1584 pipe_r 10:00 pts/1 00:00:00 grep --color=auto rpc-server
rpc-server is started like this: /opt/llama/bin/rpc-server -t 8
First Bad Commit
No response