Skip to content

Conversation

@compilade
Copy link
Collaborator

@compilade compilade commented Aug 15, 2024

There recently have been changes in gguf-py which happen to be useful for other projects, like #8939 which allows dequantizing most quant types.

ref: huggingface/transformers#27712 (comment)

There's also https://github.com/city96/ComfyUI-GGUF which already uses this feature.

Bumping the version is a necessary step to publish it to PyPI, then a tag (gguf-v0.10.0) will need to be added.


@compilade compilade added Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix python python script changes labels Aug 15, 2024
@ggerganov ggerganov merged commit 23fd453 into master Aug 16, 2024
@ggerganov ggerganov deleted the compilade/bump-gguf-py-0.10.0 branch August 16, 2024 06:36
@Ru13en
Copy link

Ru13en commented Aug 16, 2024

This will eventually fix #8925

@Isotr0py
Copy link

Isotr0py commented Aug 22, 2024

Hey, seems that the new version gguf-py hasn't released on pypi. The version of gguf-py installed from pypi is still v0.9.1.

Is there anything else to deal with before a release?

@ggerganov
Copy link
Member

ggerganov commented Aug 23, 2024

I've forgotten how the workflow works - think it needs a tag which I just created and pushed: https://github.com/ggerganov/llama.cpp/releases/tag/gguf-v0.10.0. Let's see if this will trigger a new release on pypi

https://github.com/ggerganov/llama.cpp/actions/runs/10521761400/job/29153032802

arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
Nexesenex pushed a commit to Nexesenex/croco.cpp that referenced this pull request Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python python script changes Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants