Compression fails with ERR_OUT_OF_RANGE when compressing large .ply files

[wongshek]

When attempting to compress very large .ply files (24.5 GB), the process fails during the write step to .compressed.ply. The error returned is:

[slimbuck]

Hi @wongshek,

Please could you try increasing the node/javascript heap size?

It looks like you're on windows, so you should be able to do something like this in powershell:

$env:NODE_OPTIONS="--max-old-space-size=8192"

Please let me know if that works.

Thanks!

[wongshek]

I set max-old-space-size to 65536, but the error still occurs.
It seems that the array size in Node.js is limited — the array length cannot exceed the maximum value of a 32‑bit signed integer.

[slimbuck]

Hmm yes indeed. Any chance you can share your PLY with me?

We can't overcome the nodejs limit, but we might be able to be smarter with our memory usage.

[wongshek]

Alright, I’ll try to upload it. It might require some streaming write stuff.
By the way, does Supersplat Editor have any limitations on model size or point count? I tried converting this file into the .splat format using gsbox, and the file was around 3.2GB, the vertex num was 106098060, but Supersplat couldn’t load this data.

[slimbuck]

Yes supersplat has limits which originate from browser/javascript limits. The actual limits tend to be platform specific.

[wongshek]

But I’d like to figure out whether Supersplat is heavily dependent on GPU memory. Is the ultimate bottleneck determined by GPU memory, system RAM, or the number of points?