Skip to content

Commit 1aab1c8

Browse files
authored
[BugFix] fix clear data (#4227)
* [Feature] support adapter * fix * fix * fix * fix * fix * fix * [BugFix] fix clear data * Update api_server.py
1 parent 94b6e7a commit 1aab1c8

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

fastdeploy/engine/common_engine.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -769,7 +769,8 @@ def clear_data(self):
769769
llm_logger.info("Clear Data: Start")
770770
self.token_processor.clear_data()
771771
self.engine_worker_queue.clear_data()
772-
self.zmq_server.req_dict.clear()
772+
self.send_response_server.req_dict.clear()
773+
self.recv_request_server.req_dict.clear()
773774
llm_logger.info("Clear Data: Successfully")
774775
return True
775776
except Exception as e:

fastdeploy/entrypoints/openai/api_server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -478,8 +478,8 @@ def reset_scheduler():
478478

479479
if llm_engine is None:
480480
return Response("Engine not loaded", status_code=500)
481-
llm_engine.engine.clear_data()
482481
llm_engine.engine.scheduler.reset()
482+
llm_engine.engine.clear_data()
483483
return Response("Scheduler Reset Successfully", status_code=200)
484484

485485

0 commit comments

Comments
 (0)