Ownfoil uses too much memory / crashes

[Guling85]

Hi is it normal to use over 1.5GB of memory. Is there any settings I can make it go down.

Python is using more then 1GB to run ownfoil.
My library is not so big around 40 titles

Thanks

[flagoss]

I used to have the same problem as you with Ownfoil. Memory usage was going up until full memory usage and than would crash. If I remember correctly it was caused by a couples of corrupted files. I was getting a lot of errors in the console. Tinshop was not crashing with the same library but is so outdated. So after cleaning up my library, reinstalling Owfoil the app is using 198.03 MiB of RAM after weeks of running time on a 1.27TB and 750 files library. No more crash.

[a1ex4]

@flagoss Thank you very much for this very valuable report. I have spent a good chunk of time trying to reproduce and understand where the memory leak could be, but with no success. So that is very good news!

Still, we need to figure out out to prevent this out of memory crash with problematic files. If anyone experiences this issue then please let me know here.

[testeur999]

I used to have the same problem as you with Ownfoil. Memory usage was going up until full memory usage and than would crash. If I remember correctly it was caused by a couples of corrupted files. I was getting a lot of errors in the console. Tinshop was not crashing with the same library but is so outdated. So after cleaning up my library, reinstalling Owfoil the app is using 198.03 MiB of RAM after weeks of running time on a 1.27TB and 750 files library. No more crash.

Hi @flagoss !
Same issue for me (ram growing then crash, on a 128Gb server (TrueNas), so if you have any clue to identify (easy and fast method? ;) )files causing problem (8.11TB/4201 Files Library, with somes NSP/XCI/XCZ containing also DLS/updates/SuperNSP for the NSP folder)

[a1ex4]

@testeur999 you can check the latest changes I made to try and better identify problematic files here: #271 (comment)

I'm very curious to know what file can cause such issues, looking forward your feedback!

Also if you want to prevent Ownfoil from crashing your server, you can limit the maximum memory possible in your docker-compose file.