Skip to content

Commit 0ea1cb7

Browse files
author
sd109
committed
Add log message for Mistral models
1 parent 75ca0cd commit 0ea1cb7

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

chart/web-app/app.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,8 @@
2727
# when contructing the `context` list in the `inference` function below.
2828
MISTRAL_REGEX = re.compile(r"mi(s|x)tral", re.IGNORECASE)
2929
IS_MISTRAL_MODEL = (MISTRAL_REGEX.match(settings.model_name) is not None)
30+
if IS_MISTRAL_MODEL:
31+
print("Detected Mistral model - will alter LangChain conversation format appropriately.")
3032

3133
llm = ChatOpenAI(
3234
base_url=urljoin(backend_url, "v1"),

0 commit comments

Comments
 (0)