Skip to content

Conversation

@willmj
Copy link
Collaborator

@willmj willmj commented Jan 16, 2025

release 2.4.0!

dushyantbehl and others added 8 commits December 24, 2024 00:10
Signed-off-by: Dushyant Behl <[email protected]>
fix: broken README.md link
* Allow hf dataset id to be loaded by training_data_path

Signed-off-by: Dushyant Behl <[email protected]>

* update README

Signed-off-by: Dushyant Behl <[email protected]>

* minor changes

Signed-off-by: Abhishek <[email protected]>

---------

Signed-off-by: Dushyant Behl <[email protected]>
Signed-off-by: Abhishek <[email protected]>
Co-authored-by: Abhishek <[email protected]>
* feat: accelerated MoE dataclass and init

Signed-off-by: Will Johnson <[email protected]>

* fix: author's note

Signed-off-by: Will Johnson <[email protected]>

* feat: accelerated moe in acceleration framework

Signed-off-by: Will Johnson <[email protected]>

* feat: accelerated moe to sft_trainer

Signed-off-by: Will Johnson <[email protected]>

* feat: fmt, testing

Signed-off-by: Will Johnson <[email protected]>

* fix: rename accelerated moe to fast moe

Signed-off-by: Will Johnson <[email protected]>

* test: add testing for scatter moe on accel framework

Signed-off-by: Will Johnson <[email protected]>

* fix: model, dtype, assertions

Signed-off-by: Will Johnson <[email protected]>

* fix: post init check removed from FastMoe, experimental set to True

Signed-off-by: Will Johnson <[email protected]>

* fix: if non-iterable nested dataclass, still initialize

Signed-off-by: Will Johnson <[email protected]>

* test: add failing test for wrong ep_degree

Signed-off-by: Will Johnson <[email protected]>

* fix: actually expect failure

Signed-off-by: Will Johnson <[email protected]>

* test: make sure fast moe doesn't work with non-moe model

Signed-off-by: Will Johnson <[email protected]>

* fix: regex of new test

Signed-off-by: Will Johnson <[email protected]>

* comment: explain iterable unpacking

Signed-off-by: Will Johnson <[email protected]>

* docs: fast MOE in README

Signed-off-by: Will Johnson <[email protected]>

* docs: Add note for post-processing

Signed-off-by: Will Johnson <[email protected]>

* fix: Dockerfile

Signed-off-by: Will Johnson <[email protected]>

* test: fix params

Signed-off-by: Will Johnson <[email protected]>

* fix: file path

Signed-off-by: Will Johnson <[email protected]>

* fix: expand on docs, remove from Dockerfile, move iterable data to else statement

Signed-off-by: Will Johnson <[email protected]>

* lint

Signed-off-by: Will Johnson <[email protected]>

* fix: spelling

Signed-off-by: Will Johnson <[email protected]>

---------

Signed-off-by: Will Johnson <[email protected]>
…ate (#430)

* fix: allow for padding free + pretraining

Signed-off-by: Harikrishnan Balagopal <[email protected]>

* add data collator for padding free plugin scenario to be used for extended pretraining

Signed-off-by: Dushyant Behl <[email protected]>

* fix: update value error

Signed-off-by: Mehant Kammakomati <[email protected]>

* fix: delete images only when exists

Signed-off-by: Mehant Kammakomati <[email protected]>

---------

Signed-off-by: Harikrishnan Balagopal <[email protected]>
Signed-off-by: Dushyant Behl <[email protected]>
Signed-off-by: Mehant Kammakomati <[email protected]>
Co-authored-by: Harikrishnan Balagopal <[email protected]>
Co-authored-by: Mehant Kammakomati <[email protected]>
#434)

* fix: function name from requires_agumentation to requires_augmentation

Signed-off-by: Will Johnson <[email protected]>

* fix: file path

Signed-off-by: Will Johnson <[email protected]>

* fmt

Signed-off-by: Will Johnson <[email protected]>

---------

Signed-off-by: Will Johnson <[email protected]>
@github-actions
Copy link

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.

@github-actions github-actions bot added the chore label Jan 16, 2025
@aluu317
Copy link
Collaborator

aluu317 commented Jan 16, 2025

This looks good, but could we wait 1 day to merge? Waiting to test something for PR #422 and see if I can get it merged soon

Copy link
Collaborator

@Abhishek-TAMU Abhishek-TAMU left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The current commits are in sync with the main branch. Looks good to me.

@willmj willmj closed this Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants