Skip to content

Commit 5ab69f2

Browse files
authored
fix tgi details interface (#727)
Co-authored-by: shihaobai <baishihao@sensetime.com>
1 parent 8d04a25 commit 5ab69f2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/server/api_tgi.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -130,7 +130,7 @@ async def tgi_generate_impl(request: Request, httpserver_manager: HttpServerMana
130130
ret["prompt_logprobs"] = prompt_logprobs
131131
assert ret is not None
132132
if return_details:
133-
ret["beam_sequences"] = beam_sequences
133+
ret["details"]["beam_sequences"] = beam_sequences
134134
# wrap generation inside a Vec to match api-inference
135135
json_compatible_item_data = jsonable_encoder([ret])
136136
return JSONResponse(content=json_compatible_item_data)

0 commit comments

Comments
 (0)