Skip to content

Update llama_cpp_python to 0.2.29 (Adds StableLM support)#29

Open
limdingwen wants to merge 1 commit intodanielgross:mainfrom
limdingwen:main
Open

Update llama_cpp_python to 0.2.29 (Adds StableLM support)#29
limdingwen wants to merge 1 commit intodanielgross:mainfrom
limdingwen:main

Conversation

@limdingwen
Copy link
Copy Markdown

Tested with Stable Code 3B. It is functional, at least.

@limdingwen
Copy link
Copy Markdown
Author

Example config:

import os

models = {
    "GitHub": {
        "domain": "https://copilot-proxy.githubusercontent.com",
        "type": "remote",
    },
    "stable-code-3b": {
        "url": "https://huggingface.co/stabilityai/stable-code-3b/resolve/main/stable-code-3b-Q5_K_M.gguf",
        "type": "local",
        "filename": "stable-code-3b-Q5_K_M.gguf",
    },
    "default": "stable-code-3b",
}

model_folder = os.path.expanduser("~/models")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant