feature: Improve stability of configure AI Agent Step by Windmill AI (Claude Opus 4.5)

[Marshall-Qiu]

Description

When using Windmill AI (with Claude Opus 4.5) to configure AI Agent nodes, I've encountered several issues that can leave the UI in an unrecoverable state.

Issues Encountered

1. Output type incorrectly set to json
   When providing an output JSON schema, the AI often sets the output type to json, which doesn't appear to be supported by Windmill. This causes errors.

2. Memory block configuration breaks the UI
   Memory-related settings frequently cause issues. The memory section of the AI Agent step settings sometimes disappears entirely, and the UI becomes unresponsive/stuck.

3. AI provider settings configured incorrectly
   The AI provider field is often set to invalid values, and I'm unable to correct it from the UI once it's broken.

4. UI becomes stuck with no way to recover
   When the AI misconfigures the node, the UI gets stuck and I can't interact with it to manually fix the issue. I end up blocked with no clear path forward.

Current Workaround

I've found that in the local development environment, the AI tends to get the configuration right more often. When the cloud UI gets stuck, my only option is to pull the Flow locally, fix it there, and push it back.

Suggestions

• Improve AI instructions — Provide clearer guidance to the AI about valid configurations for AI Agent nodes (valid output types, memory settings, provider options, etc.)
• Graceful error handling in UI — Even when configuration is invalid, allow users to access and edit the raw settings so we can manually fix issues instead of getting completely blocked

Environment

• Model: Claude Opus 4.5
• windmill version: CE v1.599.3

[centdix]

Hi,

Improvements were made to improve the AI efficiency on the AI Agent steps, both locally and in the interface. Could you test again on latest release ?

Changes made:

• The CLI init command will create skills and an AGENTS.md file that correctly reflects the expected schema for ai agent steps.
• In the Windmill interface, incorrect schemas for ai agent steps will be caught and returned as an error to the chat so it can auto correct.
• In case provider values are incorrect, the UI should not break anymore.

[Marshall-Qiu]

Hi @centdix, thank you so much for handling this so quickly! We're currently on vacation for Chinese New Year and will verify it on 2/23. Really appreciate the fast turnaround! 🎉

[Marshall-Qiu]

Hi @centdix, sorry for the late reply. The stability and experience are so much better now—you may close this issue. Thanks!