[Bug] 'Ask AI with Context' doesn't seem to do anything

[TFWol]

When trying to use the Chat with AI feature, it doesn't do anything except open a Web UI tab.

Maybe it doesn't work with the changes made to the relatively new llama.cpp Web UI?

[igardev]

@TFWol Yes, "Ask AI with Project Context" doesn't work after the webui (part of llama-server) was rewritten from scratch. Therefore, it was removed from llama.vscode menu. On the other hand, now you could use agent "Ask" for the same purpose with better results. The difference is that for the agent you will need a tools model (for example gpt oss 20B), which means more resources. "Ask AI with Project Context" is like using an agent with just one tool - "search_source".

[TFWol]

I get very mixed results when using the agent on very large files; I've been using continue.dev for those kinds of tasks. I liked the separate GUI chat tab since it was simple and less abstracted for quick questions. Speaking of which:

Some good news, looks like the ability to use url parameters was added to the new UI at some point:
ggml-org/llama.cpp#16938 (search "Input via URL parameters")