[Feature] add 'function (tool)' supports the processing of generator return formats. #3914
Description
MaxKB Version
2.0.2
Please describe your needs or suggestions for improvements
Add 'function (tool)' supports the processing of generator return formats.
In large model application-related functions, such as the PPT translation function, each text box in the PPT needs to be processed by calling the large model for translation. Usually, the complete execution time is relatively long, and it is necessary to output the processing progress in stages. Therefore, the function needs to support the capability of multiple returns.
Please describe the solution you suggest
In the current return configuration of functions, add a new option: "Return Type". Among the options, the "generator" type can be selected. It is sufficient to receive and process the function return results through a for loop polling.
Additional Information
This is a requirement from enterprise users. Currently, this function is not available, and the enterprise version does not support secondary development, which affects its usage.