Skip to content

server : (refactoring) do not rely on JSON internally #10643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
Dec 6, 2024
Merged

server : (refactoring) do not rely on JSON internally #10643

Show file tree
Hide file tree
Changes from 14 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
b7d38ee
server : (refactoring) reduce usage of json internally
ngxson Dec 3, 2024
1011a51
move all response types to struct
ngxson Dec 4, 2024
0d6485f
wip [no ci]
ngxson Dec 4, 2024
d2419b3
many fixes
ngxson Dec 4, 2024
ea1be7f
add virtual function
ngxson Dec 4, 2024
3b41ad5
fix index
ngxson Dec 4, 2024
1261086
minor style fix
ngxson Dec 4, 2024
eaa1288
add std::move
ngxson Dec 4, 2024
cb66671
refactor handle_completions_generic
ngxson Dec 4, 2024
8ab173c
add virtual functions
ngxson Dec 5, 2024
1cf769b
remove server.hpp
ngxson Dec 5, 2024
2e560f9
clarify server_sent_event RFC specs
ngxson Dec 5, 2024
a43e1dc
apply review comments
ngxson Dec 5, 2024
fb4b9be
fix model_alias and completion_probabilities
ngxson Dec 5, 2024
4c3d258
small clean up
ngxson Dec 5, 2024
ffc4441
remove virtual for to_json_oai_compat()
ngxson Dec 5, 2024
db66153
naming oai_compat --> oaicompat
ngxson Dec 5, 2024
dfa59b9
fix unwanted recursive call
ngxson Dec 5, 2024
25be4cc
update docs
ngxson Dec 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion common/common.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -215,7 +215,7 @@ struct common_params {
struct common_params_speculative speculative;

std::string model = ""; // model path // NOLINT
std::string model_alias = "unknown"; // model alias // NOLINT
std::string model_alias = ""; // model alias // NOLINT
std::string model_url = ""; // model url to download // NOLINT
std::string hf_token = ""; // HF token // NOLINT
std::string hf_repo = ""; // HF repo // NOLINT
Expand Down
Loading
Loading