Skip to content

what does step mean in max_steps ? #12220

Discussion options

You must be logged in to vote

it means global_step. So if you have accumulation factors = 2 and max_steps = 10, then the total training batches that will be covered here will be 20 instead of 10. global_step indicate total optimization steps.

Replies: 1 comment 2 replies

Comment options

You must be logged in to vote
2 replies
@yc1999
Comment options

@rohitgr7
Comment options

Answer selected by yc1999
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
progress tracking (internal) Related to the progress tracking dataclasses
2 participants