Hello, I am following your tutorial step. but when I run the train_bpe.py there are error about memory so, I want to know, How many ram do I need to run this program,
in my case, I have 48G ram in my computer
and this is the error message
[ 3589.194653] Out of memory: Killed process 10266 (python) total-vm:41503060kB, anon-rss:14017280kB, file-rss:75392kB, shmem-rss:8881376kB, UID:1000 pgtables:52680kB oom_score_adj:0