You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: spring-ai-docs/src/main/antora/modules/ROOT/pages/api/chat/ollama-chat.adoc
+17-2Lines changed: 17 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,7 +21,7 @@ You can pull the models you want to use in your application from the xref:https:
21
21
ollama pull <model-name>
22
22
----
23
23
24
-
You can also pull any of the thousands, free, xref:https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models]:
24
+
You can also pull any of the thousands, free, https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models]:
25
25
26
26
[source,shellscript]
27
27
----
@@ -166,7 +166,7 @@ TIP: In addition to the model specific link:https://github.com/spring-projects/s
166
166
Spring AI Ollama can automatically pull models when they are not available in your Ollama instance.
167
167
This feature is particularly useful for development and testing as well as for deploying your applications to new environments.
168
168
169
-
TIP: You can also pull, by name, any of the thousands, free, xref:https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models].
169
+
TIP: You can also pull, by name, any of the thousands, free, https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models].
170
170
171
171
There are three strategies for pulling models:
172
172
@@ -280,6 +280,21 @@ image::spring-ai-ollama-over-openai.jpg[Ollama OpenAI API compatibility, 800, 60
280
280
281
281
Check the link:https://github.com/spring-projects/spring-ai/blob/main/models/spring-ai-openai/src/test/java/org/springframework/ai/openai/chat/proxy/OllamaWithOpenAiChatModelIT.java[OllamaWithOpenAiChatModelIT.java] tests for examples of using Ollama over Spring AI OpenAI.
282
282
283
+
== HuggingFace Models
284
+
285
+
Ollama can access, out of the box, all https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face ] Chat Models.
286
+
You can pull any of these models by name: `ollama pull hf.co/<username>/<model-repository>` or configure the auto-pulling strategy: xref:auto-pulling-models[Auto-pulling Models]:
Spring AI Ollama can automatically pull models when they are not available in your Ollama instance.
167
167
This feature is particularly useful for development and testing as well as for deploying your applications to new environments.
168
168
169
-
TIP: You can also pull, by name, any of the thousands, free, xref:https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models].
169
+
TIP: You can also pull, by name, any of the thousands, free, https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face Models].
170
170
171
171
There are three strategies for pulling models:
172
172
@@ -222,6 +222,21 @@ spring:
222
222
223
223
This configuration will apply the pulling strategy to all models except embedding models.
224
224
225
+
== HuggingFace Models
226
+
227
+
Ollama can access, out of the box, all https://huggingface.co/models?library=gguf&sort=trending[GGUF Hugging Face] Embedding models.
228
+
You can pull any of these models by name: `ollama pull hf.co/<username>/<model-repository>` or configure the auto-pulling strategy: xref:auto-pulling-models[Auto-pulling Models]:
0 commit comments