I used your model to train and test it works great, but currently, I am able to understand .mat file output.
As per your code, you are using Scipy to save in mat with image and cloud points, but how can I convert to exr for viewing in the blender?
Great work by the way.