Skip to content

llama_get_kv_self debug symbols removed #2064

@Bread7

Description

@Bread7

Prerequisites

Please answer the following questions for yourself before submitting an issue.

  • I am running the latest code. Development is very rapid so there are no tagged versions as of now.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new bug or useful enhancement to share.

Expected Behavior

Debugpy should not have issues debugging the application itself.

Current Behavior

In actual development run without debugger, no issues with the latest binary.

This behaviour only occurs when DebugPy is being used to step through the processes.

Environment and Context

  • MacOS Sequoia
  • Python 3.13
  • Llama-cpp @ b6370
  • Llama-cpp-python @ 3.16

Failure Information

Image

An attribute error occurs as the debug symbol was removed 2 weeks back (mid aug 2025), see libllama api changelog.

Reproduce

This is my .vscode/launch.json settings for DebugPy

{
    "version": "0.2.0",
    "configurations": [
        {
            "_comment": "This only runs on current file instance.",
            "type": "python",
            "request": "launch",
            "name": "Standalone File Debugger",
            "program": "${file}",
            "console": "integratedTerminal",
            "justMyCode": false,
        },
    ]
}

On MacOS, the libllama.dylib might need to be updated to reflect changes of the API.

Thanks for the developing this project, not a major issue unless the debugger is needed to step through the process.

Note: installing Llama.cpp binary @ commit: b6188 allows debugging as symbols still exists (did not test other commits).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions