Skip to content

Commit 802250a

Browse files
authored
fix(request): make callbacks not require semantic_cache (#465)
Broke in 48312e7#diff-3e852cfcf107dfd78ee2b7c7e88e05428b7f2bffcfc5ca1dce0c070caf563f2aR139 Same as #399 Signed-off-by: Max Wittig <[email protected]>
1 parent 9b127b2 commit 802250a

File tree

1 file changed

+4
-4
lines changed
  • src/vllm_router/services/request_service

1 file changed

+4
-4
lines changed

src/vllm_router/services/request_service/request.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -141,10 +141,10 @@ async def process_request(
141141
await store_in_semantic_cache(
142142
endpoint=endpoint, method=request.method, body=body, chunk=cache_chunk
143143
)
144-
if background_tasks and hasattr(request.app.state, "callbacks"):
145-
background_tasks.add_task(
146-
request.app.state.callbacks.post_request, request, full_response
147-
)
144+
if background_tasks and hasattr(request.app.state, "callbacks"):
145+
background_tasks.add_task(
146+
request.app.state.callbacks.post_request, request, full_response
147+
)
148148

149149

150150
async def route_general_request(

0 commit comments

Comments
 (0)