CUDA out of memory, when it shouldn't be. #53
Description
Apologies for rubbish formatting, but Github's code insert is broken.
Using Pixray Pixeldraw, with the settings as they come, aside from:
aspect: square
drawer: vqgan
`
/content/pixray/vqgan.py in load_model(self, settings, device)
156 self.e_dim = model.quantize.e_dim
157 self.n_toks = model.quantize.n_e
--> 158 self.z_min = model.quantize.embedding.weight.min(dim=0).values[None, :, None, None]
159 self.z_max = model.quantize.embedding.weight.max(dim=0).values[None, :, None, None]
160
RuntimeError: CUDA out of memory. Tried to allocate 128.00 MiB (GPU 0; 15.90 GiB total capacity; 14.78 GiB already allocated; 15.75 MiB free; 14.88 GiB reserved in total by PyTorch)
`
Using GPU on Colab Pro (again github code insert doesn't work):
+-----------------------------------------------------------------------------+ | NVIDIA-SMI 495.44 Driver Version: 460.32.03 CUDA Version: 11.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 Tesla P100-PCIE... Off | 00000000:00:04.0 Off | 0 | | N/A 42C P0 32W / 250W | 16265MiB / 16280MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+