From 42fe54c8a1efdc119e902adf9d07842304689781 Mon Sep 17 00:00:00 2001 From: themanojshukla Date: Sun, 2 Feb 2025 22:22:47 +0530 Subject: [PATCH] Fix spell error and updated gemma model name Signed-off-by: themanojshukla --- .../main/antora/modules/ROOT/pages/api/chat/groq-chat.adoc | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/chat/groq-chat.adoc b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/chat/groq-chat.adoc index 0550b4fec80..ad2bbb7af15 100644 --- a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/chat/groq-chat.adoc +++ b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/chat/groq-chat.adoc @@ -10,7 +10,7 @@ provided https://console.groq.com/docs/models[Groq models]. image::spring-ai-groq-integration.jpg[w=800,align="center"] NOTE: The Groq API is not fully compatible with the OpenAI API. -Be aware for the following https://console.groq.com/docs/openai[compatability constrains]. +Be aware for the following https://console.groq.com/docs/openai[compatibility constrains]. Additionally, currently Groq doesn't support multimodal messages. Check the https://github.com/spring-projects/spring-ai/blob/main/models/spring-ai-openai/src/test/java/org/springframework/ai/openai/chat/proxy/GroqWithOpenAiChatModelIT.java[GroqWithOpenAiChatModelIT.java] tests @@ -24,7 +24,7 @@ The Spring AI project defines a configuration property named `spring.ai.openai.a * Set the Groq URL. You have to set the `spring.ai.openai.base-url` property to `https://api.groq.com/openai`. * Select a https://console.groq.com/docs/models[Groq Model]. -Use the `spring.ai.openai.chat.model=` property to set the Model. +Use the `spring.ai.openai.chat.options.model=` property to set the Model. Exporting an environment variable is one way to set that configuration property: @@ -115,7 +115,7 @@ The prefix `spring.ai.openai.chat` is the property prefix that lets you configur | spring.ai.openai.chat.enabled | Enable OpenAI chat model. | true | spring.ai.openai.chat.base-url | Optional overrides the spring.ai.openai.base-url to provide chat specific url. Must be set to `https://api.groq.com/openai` | - | spring.ai.openai.chat.api-key | Optional overrides the spring.ai.openai.api-key to provide chat specific api-key | - -| spring.ai.openai.chat.options.model | The avalable https://console.groq.com/docs/models[model] names are `llama3-8b-8192`, `llama3-70b-8192`, `mixtral-8x7b-32768`, `gemma-7b-it`. | - +| spring.ai.openai.chat.options.model | The https://console.groq.com/docs/models[available model] names are `llama3-8b-8192`, `llama3-70b-8192`, `mixtral-8x7b-32768`, `gemma2-9b-it`. | - | spring.ai.openai.chat.options.temperature | The sampling temperature to use that controls the apparent creativity of generated completions. Higher values will make output more random while lower values will make results more focused and deterministic. It is not recommended to modify temperature and top_p for the same completions request as the interaction of these two settings is difficult to predict. | 0.8 | spring.ai.openai.chat.options.frequencyPenalty | Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | 0.0f | spring.ai.openai.chat.options.maxTokens | The maximum number of tokens to generate in the chat completion. The total length of input tokens and generated tokens is limited by the model's context length. | -