Autocomplete doesn't work

[wvdschel]

Autocomplete doesn't seem to work. Chatting does work. I'm running a bunch of Qwen3 models in llama-swap. Autocomplete works using other tools, and chat works with my local models in Continue as well.

Here is my config:

name: My Assistant
version: 1.0.0
schema: v1
models:
  - name: "Qwen3 Coder 30B (local)"
    provider: llamastack
    model: "qwen3-coder"
    apiBase: http://localhost:12434/v1
    apiKey: lol
    roles:
      - chat
      - autocomplete
    capabilities:
      - tool_use
    promptTemplates:
      autocomplete: |
        `
        <|fim_prefix|>{{{prefix}}}<|fim_suffix|>{{{suffix}}}<|fim_middle|>
        `
  - name: "Qwen3 rerank (local)"
    provider: llamastack
    model: "qwen3-rerank"
    apiBase: http://localhost:12434/v1
    roles:
      - rerank
  - name: "Qwen3 embedding (local)"
    provider: llamastack
    model: "qwen3-embed"
    apiBase: http://localhost:12434/v1
    roles:
      - embed
  - name: "Qwen2.5-Coder 7B (local)"
    provider: llamastack
    model: "qwen2.5-coder"
    roles:
      - autocomplete
    apiBase: http://localhost:12434/v1
    promptTemplates:
      autocomplete: |
        `
        <|fim_prefix|>{{{prefix}}}<|fim_suffix|>{{{suffix}}}<|fim_middle|>
        `
  - name: $$ Qwen3 Coder (OpenRouter)
    provider: openrouter
    model: qwen/qwen3-coder@preset/fp8
    roles:
      - chat
      - autocomplete
    capabilities:
      - tool_use
    apiBase: https://openrouter.ai/api/v1
    apiKey: lol
  - name: Coding Free (OpenRouter)
    provider: openrouter
    model: "@preset/free-coding"
    roles:
      - chat
      - autocomplete
    capabilities:
      - tool_use
    apiBase: https://openrouter.ai/api/v1
    apiKey: lol
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

I've also tried autocomplete using openrouter, it also doesn't work.

Checking the server logs, I see nothing hitting my llama-swap server when I force autocomplete.