I relly want a local LLM "mechanic" role.

[aarond10]

If I had more time I'd try to code this myself.

Swiss army-knife local LLM agent.

What I'm after is a "Swiss army knife" agent that is great with tools but not very intelligent. It is backed by a local LLM with strong tool capabilities. Tokens are essentially "free" for this agent.

It's purpose for existing is a poly-fill of sorts. It can use tools correctly (i.e. better than Gemini Pro 2.5). It can serve as a custom tool (e.g. rename all files to snake_case and fix references). It can perform basic coding changes given examples (e.g. replace for i in 0..10 { let x = arr[i]; ... } with the more idiomatic for (i, x) in arr.iter().enumerate() { ... }).

The idea is that this is a much cheaper way to execute changes that aren't relevant to long-term context. i.e. The agent doesn't need to waste context window tokens on this stuff once it's completed.

What's needed?

I imagine just the ability to assign a customRole to a configuration override.