server: Add timeout to stop the server automatically when idling for too long.#10742

Open

Sumandora wants to merge 7 commits intoggml-org:masterfrom

Sumandora:master

Commits on Dec 11, 2024

server: Return shutdown_handler to its initial state and use running = false for termination
Sumandora
committed
server: Initialize standby_timeout over constructor instead of passing as argument
Sumandora
committed
server: Propagate standby_timeout after it has been initialized
Sumandora
committed