Catnip Cached Buffers seem to not work on world load (NeoForge)

[Electrisoma]

I've been working on a project for a couple of months now
My items are all rendered using partial models that I've set up using SuperByteBufferCache and then registering the compartments using CachedBuffers.PARTIAL, CachedBuffers.GENERIC_BLOCK, and CachedBuffers.DIRECTIONAL_PARTIAL

This works just fine on Fabric
NeoForge not so much
On NeoForge the partials seem to have a 50/50 chance of returning null or not, requiring you to reload the resources (if you even put the correct checks in place to prevent null models from trying to render)

Here's a client crash that you can expect for such occasion
https://mclo.gs/YgkxsNe

The NeoForge side seems to be the only one with this problem from what I can see so most likely a NeoForge implementation issue
That or a problem on my end, but I really cannot think of what it could be