[Bug] Picture understanding The setting of the maximum token number output is useless, no matter how you change it, it is the default 800

[chenslcool]

Contact Information

No response

MaxKB Version

1.10

Problem Description

高级编排->图片理解，设置输出最大token数为65536，在后端查看vllm的log，发现max token请求参数是800，改成10的话，也是800。
大语言模型没这个问题

Steps to Reproduce

高级编排->图片理解，设置输出最大token数为65536，在后端查看vllm的log，发现max token请求参数是800，改成10的话，也是800。
大语言模型没这个问题

The expected correct result

max token能被设置为高级编排中的设置值

Related log output

Additional Information

No response

[chenslcool]

暂时没有版本更新的话，有没有办法源码改一下？

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

If there is no version update for the time being, is there any way to change the source code?

[zyyfit]

感谢反馈，后续版本修复

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Thanks for the feedback, subsequent version fixes

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@chenslcool @shaohuzhang1 The temporary solution can modify the source code and adjust the configuration file of the corresponding model, see: https://blog.csdn.net/m0_60783063/article/details/145869790

[zyyfit]

1.10.2版本已修复，请等待版本发布后验证

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Version 1.10.2 has been fixed, please wait for the version to be released to verify