Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gguf-py : bump version from 0.9.1 to 0.10.0 #9051

Merged
merged 1 commit into from
Aug 16, 2024

Conversation

compilade
Copy link
Collaborator

@compilade compilade commented Aug 15, 2024

There recently have been changes in gguf-py which happen to be useful for other projects, like #8939 which allows dequantizing most quant types.

ref: huggingface/transformers#27712 (comment)

There's also https://github.com/city96/ComfyUI-GGUF which already uses this feature.

Bumping the version is a necessary step to publish it to PyPI, then a tag (gguf-v0.10.0) will need to be added.


@compilade compilade added Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix python python script changes labels Aug 15, 2024
@ggerganov ggerganov merged commit 23fd453 into master Aug 16, 2024
8 checks passed
@ggerganov ggerganov deleted the compilade/bump-gguf-py-0.10.0 branch August 16, 2024 06:36
@Ru13en
Copy link

Ru13en commented Aug 16, 2024

This will eventually fix #8925

@Isotr0py
Copy link

Isotr0py commented Aug 22, 2024

Hey, seems that the new version gguf-py hasn't released on pypi. The version of gguf-py installed from pypi is still v0.9.1.

Is there anything else to deal with before a release?

@ggerganov
Copy link
Owner

ggerganov commented Aug 23, 2024

I've forgotten how the workflow works - think it needs a tag which I just created and pushed: https://github.com/ggerganov/llama.cpp/releases/tag/gguf-v0.10.0. Let's see if this will trigger a new release on pypi

https://github.com/ggerganov/llama.cpp/actions/runs/10521761400/job/29153032802

arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
python python script changes Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants