How to convert pytorch_model.bin models to gguf?

[Romanio1997]

nothing is understood I downloaded koboldcpp_tools_19dec how to convert pytorch_model.bin models to gguf?

C:\AI\download ai model for convert scripts\koboldcpp_tools_19dec>python convert_hf_to_gguf.py "c:\AI\download ai model for convert scripts\keywordGen-v2" --outtype f32
INFO:hf-to-gguf:Loading model: keywordGen-v2
ERROR:hf-to-gguf:Model T5Model is not supported

[jabberjabberjabber]

You can't convert any 'bin' file to gguf, it has to be compatible.

[LostRuins]

What model are you looking for? Usually they can already be found on huggingface, just search for gguf

[Romanio1997]

KeywordGen-v1 is a T5-based model fine-tuned for keyword generation from a piece of text. Given an input text, the model will return relevant keywords.
The model is located here: https://huggingface.co/mrutyunjay-patil/keywordGen-v2
I chose it for keyword selection (keyword-generation - it's built to do just that) wanted to see, I found a normal solution launch oobabooga-text-generation-webui it worked there without conversion this model.

If you look at only these two models, they are customized for keyword-generation huggingface platform.

Of course, you could choose any other linguistic model—they could do the same thing. But I just wanted to test this one, as it’s specifically designed for generating keywords from text.

[LostRuins]

I don't think T5 architecture is supported. But there are many other models that can do the same thing, in fact most modern LLMs will be able to do this task.