Skip to content

Commit 5aa5d41

Browse files
Merge pull request #94286 from rh-tokeefe/OLS-1757
OLS-1757: mention tool calling for cluster interaction
2 parents fa15331 + 0d44669 commit 5aa5d41

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

modules/ols-cluster-interaction-overview.adoc

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,11 @@
55
[id="cluster-interaction-overview_{context}"]
66
= Cluster interaction overview
77

8-
A large language model (LLM) is used with the {ols-long} service to generate responses to questions. Use the cluster interaction feature to enhance the knowledge available to the LLM with information about an {ocp-product-title} cluster. Providing cluster information, such as the namespaces or pods that the cluster contains, enables the LLM to generate highly customized responses for your environment.
8+
A large language model (LLM) is used with the {ols-long} service to generate responses to questions. Use the cluster interaction feature to enhance the knowledge available to the LLM with information about an {ocp-product-title} cluster. Providing cluster information, such as the namespaces or pods that the cluster contains, enables the LLM to generate highly customized responses for your environment.
9+
10+
Function calling, also known as tool calling, is a capability that enables an LLM to interact with external APIs. {ols-long} uses the `auto` setting for the tool choice parameter of the LLM to make API calls to the LLM provider. To activate the cluster interaction feature in the {ols-long} service, tool calling must be enabled in the LLM provider.
11+
12+
[NOTE]
13+
====
14+
Enabling tool calling can dramatically increase token usage. When you use public model providers, increased token usage can result in greater billing costs.
15+
====

0 commit comments

Comments
 (0)