Question about BGE models and merging to GGUF or GGML #194
Unanswered
leighgable
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello! MNN looks incredible! @wangzhaode
I have a question. I saw a comment in this thread over on the llama.cpp repo about converting bge-large-zh to c++. Could you tell me how you went about that? Did you use a llama.cpp convert script? I am trying to convert a fine-tuned version off HuggingFace into a gguf format, but it's not recognizing the model architecture...
Beta Was this translation helpful? Give feedback.
All reactions