Hello! I tried fine-tune a model and convert it to gguf format, but got this error:
Traceback (most recent call last): File "/mnt/floppy/finetune/unsloth/./Qwen3_(4B)-Instruct.py", line 218, in <module> model.save_pretrained_gguf("model", tokenizer, quantization_method = "f16") File "/mnt/floppy/finetune/unsloth/.unsloth/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/mnt/floppy/finetune/unsloth/.unsloth/lib/python3.12/site-packages/unsloth/save.py", line 2287, in save_to_gguf_generic install_llama_cpp(just_clone_repo = True) File "/mnt/floppy/finetune/unsloth/.unsloth/lib/python3.12/site-packages/unsloth_zoo/llama_cpp.py", line 284, in install_llama_cpp sudo = do_we_need_sudo() ^^^^^^^^^^^^^^^^^ File "/mnt/floppy/finetune/unsloth/.unsloth/lib/python3.12/site-packages/unsloth_zoo/llama_cpp.py", line 118, in do_we_need_sudo raise RuntimeError("[FAIL] Unsloth: apt-get does not exist? Is this NOT a Linux / Mac based computer?") RuntimeError: [FAIL] Unsloth: apt-get does not exist? Is this NOT a Linux / Mac based computer?

I'm running Gentoo Linux and obviously on't have apt-get. I 'fixed' it by creating empty file called apt-get and then conversion to gguf went successfully. Previously I didn't face this issue. And I'm not sure my 'solution' will work after future updates of this package. Please, think about users of other distros. Seriously, Ubuntu is not only one!