Skip to content

Commit d928ff4

Browse files
author
ochafik
committed
server: catch errors in oaicompat_completion_params_parse instead of taking server down
1 parent a774093 commit d928ff4

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

examples/server/server.cpp

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2860,7 +2860,13 @@ int main(int argc, char ** argv) {
28602860
return;
28612861
}
28622862

2863-
json data = oaicompat_completion_params_parse(ctx_server.model, json::parse(req.body), params.chat_template, params.use_jinja);
2863+
json data;
2864+
try {
2865+
data = oaicompat_completion_params_parse(ctx_server.model, json::parse(req.body), params.chat_template, params.use_jinja);
2866+
} catch (const std::runtime_error & e) {
2867+
res_error(res, format_error_response(e.what(), ERROR_TYPE_NOT_SUPPORTED));
2868+
return;
2869+
}
28642870

28652871
std::vector<server_task> tasks = ctx_server.create_tasks_cmpl(data, SERVER_TASK_CMPL_TYPE_NORMAL);
28662872
ctx_server.queue_results.add_waiting_tasks(tasks);

0 commit comments

Comments
 (0)