Skip to content

How many ram storage do we need to run this program #24

@yblee1223

Description

@yblee1223

Hello, I am following your tutorial step. but when I run the train_bpe.py there are error about memory so, I want to know, How many ram do I need to run this program,
in my case, I have 48G ram in my computer

and this is the error message

[ 3589.194653] Out of memory: Killed process 10266 (python) total-vm:41503060kB, anon-rss:14017280kB, file-rss:75392kB, shmem-rss:8881376kB, UID:1000 pgtables:52680kB oom_score_adj:0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions