fix: remove default temperature on all QueryTransformer implementations

Signed-off-by: Alexandros Pappas <[email protected]>

update documentation

Signed-off-by: Alexandros Pappas <[email protected]>
Signed-off-by: “claudio-code” <[email protected]>

Author: apappascs

spring-ai-docs/src/main/antora/modules/ROOT/pages/api/retrieval-augmented-generation.adoc

@@ -172,6 +172,8 @@ Pre-Retrieval modules are responsible for processing the user query to achieve t
 A component for transforming the input query to make it more effective for retrieval tasks, addressing challenges
 such as poorly formed queries, ambiguous terms, complex vocabulary, or unsupported languages.
 
+IMPORTANT: When using a `QueryTransformer`, it's recommended to configure the `ChatClient.Builder` with a low temperature (e.g., 0.0) to ensure more deterministic and accurate results, improving retrieval quality.  The default temperature for most chat models is typically too high for optimal query transformation, leading to reduced retrieval effectiveness.
+
 ===== CompressionQueryTransformer
 
 A `CompressionQueryTransformer` uses a large language model to compress a conversation history and a follow-up query

spring-ai-rag/src/main/java/org/springframework/ai/rag/preretrieval/query/transformation/CompressionQueryTransformer.java

@@ -84,7 +84,7 @@ public Query transform(Query query) {
 			.user(user -> user.text(this.promptTemplate.getTemplate())
 				.param("history", formatConversationHistory(query.history()))
 				.param("query", query.text()))
-			.options(ChatOptions.builder().temperature(0.0).build())
+			.options(ChatOptions.builder().build())
 			.call()
 			.content();
 

spring-ai-rag/src/main/java/org/springframework/ai/rag/preretrieval/query/transformation/RewriteQueryTransformer.java

@@ -82,7 +82,7 @@ public Query transform(Query query) {
 			.user(user -> user.text(this.promptTemplate.getTemplate())
 				.param("target", this.targetSearchSystem)
 				.param("query", query.text()))
-			.options(ChatOptions.builder().temperature(0.0).build())
+			.options(ChatOptions.builder().build())
 			.call()
 			.content();
 

spring-ai-rag/src/main/java/org/springframework/ai/rag/preretrieval/query/transformation/TranslationQueryTransformer.java

@@ -91,7 +91,7 @@ public Query transform(Query query) {
 			.user(user -> user.text(this.promptTemplate.getTemplate())
 				.param("targetLanguage", this.targetLanguage)
 				.param("query", query.text()))
-			.options(ChatOptions.builder().temperature(0.0).build())
+			.options(ChatOptions.builder().build())
 			.call()
 			.content();