How to use any model (onnx or gguf) with tauri-plugin-llm

[Keshav-writes-code]

so, i am trying to use a small language model called : SmolLM2-135M-Instruct which is quite smaller than the smallest supported, Qwen's 3B model that i wish to integrate in a tauri app. can't get it to work with tauri-plugin-llm.

my question is how can i bypass tauri-plugin-llm's model name validaton to run any model i want

[FabianLars]

you may be better off asking the plugin maintainers directly in their repo https://github.com/crabnebula-dev/tauri-plugin-llm - doesn't look good though, pretty sure you'll have to modify the plugin source code.