Skip to content

Conversation

@pbontrager
Copy link
Contributor

@pbontrager pbontrager commented Aug 29, 2025

This updates each part of the calculations to use reference versions. It also updates the data structures to handle batched processing and be group agnostic.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Aug 29, 2025
@pbontrager pbontrager marked this pull request as ready for review September 1, 2025 21:40
Copy link
Member

@joecummings joecummings left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple questions, but generally looks good

@pbontrager pbontrager changed the title [WIP] Group Rollout Trainer Changes Group Rollout Trainer Changes Sep 5, 2025
@pbontrager pbontrager merged commit 98856ab into main Sep 5, 2025
2 of 5 checks passed
photomz pushed a commit to photomz/forge that referenced this pull request Oct 25, 2025
* first changes

* core updates

* batch update

* fix typo

* missing import

* debug merge

* more fixes

* Remove dtype warnings

* Stub

* It runs

* Add in ref

* Pass linting?

* Remove extraneous 'calculations'

* Stub out push weights

* Remove tokenizer, add back in formatting

* Cleanup

* Updated default group

* update CI

* added tyro

* reverted build changes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants