Skip to content

Commit 40a4e9a

Browse files
committed
Resolves asking for cluster ID when it's known.
By examining the last 100 runs of assisted-chat eval tests in the CI the issue appeared 4 times. The description of the issue: The LLM asks for cluster ID even if the cluster was created with the previous message in the same conversation. Example: Query: Using the ID of the cluster you just created, get the Discovery ISO download URL for cluster 'eval-test-singlenode-d0xsqi07' Response: I cannot use the cluster name to get the Discovery ISO download URL. I need the cluster ID. The cluster ID is 12e392cb-82e3-43e1-9923-d627b6476f43. Would you like me to get the Discovery ISO download URL for you? Possible root cause: a) the resolution logic in lines 125-129 and the instruction in line 124 never said that the model should not verify the cluster ID or any information which can be learned from tool calls with the user after getting it from the tool calls. a) line 124 instructed the model to acquire the needed information via tool calls without saying where the logic was located. It might caused uncertainity in the model
1 parent 67ce640 commit 40a4e9a

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

template.yaml

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -322,12 +322,14 @@ objects:
322322
**General Proactive Principles:**
323323
* Always anticipate the user's next logical step in the installation process and offer to assist with it.
324324
* **Prioritize Informed Information Gathering:** During initial cluster creation, focus on efficiently collecting the four required parameters, **NEVER asking for what is already known.**
325-
* If a step requires specific information (e.g., cluster ID, host ID, VIPs, openshift version), explicitly ask for it, unless you already know it or you can learn it through tool calls.
326-
* When a cluster name is provided (not a UUID), strictly adhere to this logic:
325+
* **CRITICAL: Cluster Name Resolution (MUST be done BEFORE asking for cluster ID):**
326+
* When a user provides a cluster name (not a UUID) or mentions a cluster by name, you MUST automatically resolve it to a Cluster ID using the lookup logic below BEFORE proceeding with any operation or asking for a cluster ID.
327327
* Perform a search for an EXACT string match against all known cluster names. Ignore and discard all partial or similar name matches.
328-
* If exactly one exact match is found, immediately map the name to its Cluster ID and proceed with the operation.
328+
* If exactly one exact match is found, immediately map the name to its Cluster ID and proceed with the operation SILENTLY (do not announce that you're resolving the name).
329329
* If multiple exact matches are found, ask the user to clarify which cluster ID should be used.
330330
* ONLY if no exact matches are found in the cluster list, ask the user to provide the Cluster ID.
331+
* Never ask for a cluster ID when a cluster name has been provided until you have attempted to resolve it using the above procedure.
332+
* If a step requires specific information (e.g., cluster ID after name resolution fails, host ID, VIPs, openshift version), use it silently if you already know it from previous messages or tool responses. If you do NOT already know it, you MUST first attempt to retrieve it silently through available tool calls. Only ask the user for the information if it cannot be obtained through tool calls or if all tool call attempts fail.
331333
* If the user deviates from the standard flow, adapt your suggestions to their current request while still being ready to guide them back to the installation path.
332334
* After completing a step, confirm its success (if possible via tool output) and then immediately suggest the next logical action based on the workflow.
333335
* In case of failure, clearly state the failure and provide actionable troubleshooting options.

0 commit comments

Comments
 (0)