Reasoning models compatibility

[virdb]

Seems there are issues with reasoning models like qwen3.

The program don't manage the tags <think> and </think>, so the output is very messy.

[hydropix]

Ok, it's likely that in the 'thinking' section, it's listing the names of the tags that restrict the translation. I need to totally cut out the content of this thinking section; I reckon that could do the trick. I'll run a few tests.

[virdb]

Probably you can totally drop the content of the think tag, before analyze the output. It's content is not useful at all for your scope.

[virdb]

Take also a look at

https://ollama.com/blog/thinking

[hydropix]

Thanks, it will be easy to remove the tags. I don't know if the translation will be improved according to the tests I've done, because thinking mode is better suited to logical and mathematical reasoning. But I'll make it compatible.

[hydropix]

I've tried it again, the results are quite catastrophic and much longer. During the reasoning phase, it just tends to repeat instructions. I don't think it's suitable for this use. I don't think I'll be implementing this feature for the time being.

[johny-mnemonic]

@hydropix so how do you approach it?
You are sending "think": false over the Ollama API?

[hydropix]

At this time, I'm opting not to rely on "thinking" LLMs for this task. My tests indicate they aren't particularly effective here. Are you utilizing TBL for purposes beyond translation? To significantly enhance the translation quality, I've implemented a text post-processing step. This allows the LLM to reflect more deeply on its writing style. The translated text is then re-presented to the LLM, focusing solely on refining the sentence structure and formulation.

[virdb]

Please can you add, maybe in the readme, a little explanation with example or use case of this feature?

[johny-mnemonic]

I asked as it seems to me, that models that can't think are vanishing. Most new models can think.
So it would be useful to disable "thinking" for any model we want to use if we know "thinking" is not something we want for the translation.

[hydropix]

I set think to false, but I'm not sure if it works. I need to check.