Misc. bug: webui: extreme sluggish performance typing into textarea with long-context conversations

[woof-dog]

Name and Version

version: 4690 (4078c77)
built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu

Operating systems

Linux

Which llama.cpp modules do you know to be affected?

llama-server

Command line

llama-server -m <any model>

Problem description & steps to reproduce

The user textarea has extreme sluggish performance when typing when the conversation above has a lot of context.

1. Write a very long message (16K+ tokens) and send.
2. Try typing into the textarea. Sluggish performance. Are we rerendering a component like ChatScreen on each keystroke and doing complex computations on the previous messages? I can't easily spot it myself if we are.

First Bad Commit

New React UI commit but not entirely sure

Relevant log output

[woof-dog]

@ngxson I haven't had time to investigate the root cause but this is still a pretty big problem, after a few turns of code writing the interface becomes noticeably slow.

[zunigasllc]

Hello El jue, 20 de mar de 2025, 10:59 a. m., Xuan-Son Nguyen < ***@***.***> escribió:

…

Closed #11813 <#11813> as completed via #12299 <#12299>. — Reply to this email directly, view it on GitHub <#11813 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BQFRXQ4TY7NWN6ZXKYHJPLD2VLJVDAVCNFSM6AAAAABW6V6NAGVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJWHEYTENJVGY4TMOA> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>