feat(server): enhance server concurrency with task queue, worker threads, and graceful shutdown#3181

Closed

sachaarbonel wants to merge 16 commits intoggml-org:masterfrom

sachaarbonel:server-task-queue

Commits on May 26, 2025

removed unused std::chrono_literals
sachaarbonel
committed
Remove redundant decrement of active tasks in process_transcription_tasks function in server.cpp
sachaarbonel
committed
improve readability of task queue slot release in process_transcription_tasks function
sachaarbonel
committed
Refactor thread creation in server.cpp to improve clarity by removing unnecessary std::thread initialization syntax in worker thread setup.
sachaarbonel
committed
improve readability and consistency of ThreadGuard
sachaarbonel
committed
improved readability in error_type_to_http_status
sachaarbonel
committed
line up the indentation in error_type_to_string
sachaarbonel
committed
Refactor HttpRequestCounter constructor in server.cpp to enhance readability by aligning the initialization syntax.
sachaarbonel
committed
Refactor destructor of HttpRequestCounter in server.cpp to improve readability by adding line breaks for clarity.
sachaarbonel
committed
Align formatting of temporary upload directory usage message in server.cpp for improved readability.
sachaarbonel
committed