Skip to content

Commit b0d9660

Browse files
fix output issue 4 ui (#50)
1 parent 9ed5a23 commit b0d9660

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

llmserve/backend/llm/predictor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -459,7 +459,7 @@ def slice_prompts(worker_num: int, worker_index: int, prompts: list[str]):
459459
for worker in self.base_worker_group
460460
]
461461
)
462-
)
462+
)[0]
463463

464464
return prediction
465465

llmserve/backend/server/app.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -423,7 +423,7 @@ async def query(self, *args) -> Dict[str, Dict[str, Any]]:
423423
)
424424
logger.info(f"ExperimentalDeployment query.results {results}")
425425
results = results[0]
426-
return results
426+
return results.generated_text
427427

428428
def _chose_ui(self) -> Callable:
429429
logger.info(

0 commit comments

Comments
 (0)