Rpc improvement#480

Merged

ikawrakow merged 20 commits intoikawrakow:mainfrom

firecoperana:rpc_improvement

Jun 8, 2025

Commits on May 31, 2025

Add RPC backend in device list to override tensors.
firecoperana
committed
rpc : prevent crashes on invalid input (#9040)

rgerganov
authored and
firecoperana
committed
rpc : print error message when failed to connect endpoint (#9042)

rgerganov
authored and
firecoperana
committed
Fix RPC error
firecoperana
committed
Add vulkan, sycl to rpc backend
firecoperana
committed
add thread in rpc cpu backend
firecoperana
committed
add cache folder and other improvement in rpc
firecoperana
committed
add header file
firecoperana
committed
support for models with non-512 aligned tensors

matt23456
authored and
firecoperana
committed
rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943)

rgerganov
authored and
firecoperana
committed
fix(rpc): Improve input validation and error handling (#13069)

thevilledev
authored and
firecoperana
committed
rpc : fix cache directory initialization (#13188)

hbuxiaofei
authored and
firecoperana
committed
rpc : avoid uninitialized memory in serialize_tensor (#13210)

justinsb
authored and
firecoperana
committed
fix merge error
firecoperana
committed
Add hello command in RPC
firecoperana
committed
bug fix
firecoperana
committed
add rpc header
firecoperana
committed
fix bug for missing rpc names
firecoperana
committed
add tpc no delay for rpc
firecoperana
committed
add back webui
firecoperana
committed