memory allocation issue #16
Description
Hi, I was trying to get working the ReadPhilips node and I'm getting memory allocation issues, in particular, I get the following error:
File "ReadPhilips_GPI.py", line 574, in compute File "readPhilipsExports.py", line 1506, in readRaw numpy.core._exceptions._ArrayMemoryError: Unable to allocate 97.3 GiB for an array with shape (28, 1, 450, 1, 9, 1, 1, 1, 1, 1, 1, 450, 256) and data type complex64
So the library is trying to pre-allocate almost a 100GB for the array shown with those dimensions. Clearly, trying to pre-allocate memory for all the dimensions of the array seems kinda unnecessary (dimensions with size 1), they may provide useful information in the reading process but considering all of them in the pre-allocation step seems overkill. Is there anyway to circumvent this issue? It may not even be related directly with the code, maybe it has to do with the .sin file, I don't know, it would be really helpful to get some guidance so I can perform the functionality that I'm looking for.