feat: add base_url to ChatOllama to read from remote server

MeshkatShB · MeshkatShB · commit 332eeab4e764 · 2025-01-15T15:29:08.000+03:30
diff --git a/src/utils/utils.py b/src/utils/utils.py
@@ -89,6 +89,7 @@ def get_llm_model(provider: str, **kwargs):
             model=kwargs.get("model_name", "qwen2.5:7b"),
             temperature=kwargs.get("temperature", 0.0),
             num_ctx=128000,
+            base_url=kwargs.get("base_url", "http://localhost:11434"),
         )
     elif provider == "azure_openai":
         if not kwargs.get("base_url", ""):

Original file line number	Diff line number	Diff line change
`@@ -89,6 +89,7 @@ def get_llm_model(provider: str, **kwargs):`
`89`	`89`	`model=kwargs.get("model_name", "qwen2.5:7b"),`
`90`	`90`	`temperature=kwargs.get("temperature", 0.0),`
`91`	`91`	`num_ctx=128000,`
	`92`	`+ base_url=kwargs.get("base_url", "http://localhost:11434"),`
`92`	`93`	`)`
`93`	`94`	`elif provider == "azure_openai":`
`94`	`95`	`if not kwargs.get("base_url", ""):`