Integration of web searches

[rthwm]

Love Koboldcpp and how it works! I was needing a means to have the AI access live/current data from the web. After installing text-generation-webui with the extension "LLM_Web_search", I was able to get it to work almost perfectly. I just really don't like the UI and much prefer KoboldCPP. Just curious if there might be a way to integrate this feature into a future release.

[LostRuins]

Now Added in 1.81

[LostRuins]

You can see the search query triggered, and the result embedded into the prompt

[rthwm]

First off, thank you for the integration! I am experimenting with it and it does appear to be working (I can see the web sources in the logs that it is pulling information from). Will need to experiment with the output's a little bit. When I tried to get it to tell me the current date and/or current time, I can see the sources that it is pulling from, but the information that is given in the response doesn't match what the sources are actually telling it. ex: "what is today's date in central united states". Logs shows it did a search and found answers on 24timezones.com and timeanddate.com, which both sites do give the correct date/time information, but the LLM is returning the wrong date/time from what the sources are telling it.

[VL4DST3R]

I am curious regarding the websearch: how does it manage to detect when it should perform a search and when not?

[LostRuins]

You have to toggle it on/off. There's now a button to do so.

[VL4DST3R]

Got it. In the old initial release it seemed to search only sometimes, so I left thinking there was more to it but now indeed it seems to be consistently searching (or not) depending on the button state, which is very straightforward, thank you.