Disk Offloading

[TomLucidor]

Working with Qwen3-Coder-Next and see if it fits into 32/48GB of memory, it nearly succeeded for the models alone but the KV cache is harder to fit inside the whole thing, thinking if there are smart ways of using this along side disk offloading.