Skip to content

Commit a9c46cd

Browse files
authored
fix: Reorganize the model cache (#3315)
1 parent a9e9f5b commit a9c46cd

File tree

1 file changed

+3
-0
lines changed
  • apps/setting/models_provider/impl/xinference_model_provider/model

1 file changed

+3
-0
lines changed

apps/setting/models_provider/impl/xinference_model_provider/model/reranker.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,9 @@ class XInferenceReranker(MaxKBBaseModel, BaseDocumentCompressor):
2222
"""UID of the launched model"""
2323
api_key: Optional[str]
2424

25+
@staticmethod
26+
def is_cache_model():
27+
return False
2528
@staticmethod
2629
def new_instance(model_type, model_name, model_credential: Dict[str, object], **model_kwargs):
2730
return XInferenceReranker(server_url=model_credential.get('server_url'), model_uid=model_name,

0 commit comments

Comments
 (0)