some info regarding Multi GPU #1234
FurkanGozukara
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Dear @kohya-ss, @KohakuBlueleaf can you give some info regarding Multi GPU that is coming with this pull request
https://github.com/bmaltais/kohya_ss/pull/2192/files
Previously, when we were training on a multi gpu platform, it was cloning the training process on each gpu
so lets say training on 1 gpu takes 20 gb. this was cloned on all gpus
thus lets say if i have 2 gpus, it was becoming effective batch size 2
with this new options can you explain difference? how to utilize? any info? thank you so much
Beta Was this translation helpful? Give feedback.
All reactions