Can you make it load layer partially onto the IGPU.

[sorasoras]

most CPU these that come with an IGPU.
The question is can it load your model partially or all of them onto the IGPU regardless of the GPU has/hasn't enough VRM, because fo IGPU, the system ram is the vram, so that you can have GPU acceleration on a laptop
just provide a option to load selected number of layer that load onto GPU like llama cpp does in the command.

[cebtenzzre]

Partial offloading is tracked in #1562. This being a feature request, it doesn't belong in "Discussions" anyway. I am close to disabling this tab altogether because it seems like nobody understands what it's for.

[sorasoras]

Fine, sorry about that.