Skip to content

Commit fbf12cb

Browse files
kmehantromitjainseshapad
authored
feat: add online data mixing plugin (#152)
* feat: add online data mixing plugin Co-authored-by: romit <[email protected]> Co-authored-by: Padmanabha V Seshadri <[email protected]> Signed-off-by: Mehant Kammakomati <[email protected]> * feat: add odm tests and lint to ci/cd Co-authored-by: romit <[email protected]> Co-authored-by: Padmanabha V Seshadri <[email protected]> Signed-off-by: Mehant Kammakomati <[email protected]> * nit: bump up min python to 3.11 Signed-off-by: Mehant Kammakomati <[email protected]> * feat: refactor on changes discussed Signed-off-by: Mehant Kammakomati <[email protected]> * fix: code refactor Signed-off-by: Mehant Kammakomati <[email protected]> * fix: code refactor Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: add custom loop and docs Signed-off-by: Mehant Kammakomati <[email protected]> * docs: add docs Signed-off-by: Mehant Kammakomati <[email protected]> * fix: bump up python version to 3.11 Signed-off-by: Mehant Kammakomati <[email protected]> --------- Signed-off-by: Mehant Kammakomati <[email protected]> Co-authored-by: romit <[email protected]> Co-authored-by: Padmanabha V Seshadri <[email protected]>
1 parent c3bb0cf commit fbf12cb

File tree

22 files changed

+2053
-7
lines changed

22 files changed

+2053
-7
lines changed

‎.github/workflows/build-and-publish.yml‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,14 +8,15 @@ jobs:
88
strategy:
99
matrix:
1010
python-version:
11-
- setup: "3.10"
12-
tox: "py310"
11+
- setup: "3.11"
12+
tox: "py311"
1313
plugin_name:
1414
- "framework"
1515
- "accelerated-peft"
1616
- "fused-ops-and-kernels"
1717
- "attention-and-distributed-packing"
1818
- "accelerated-moe"
19+
- "online-data-mixing"
1920

2021
permissions:
2122
id-token: write # IMPORTANT: this permission is mandatory for trusted publishing

‎.github/workflows/format.yml‎

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -31,13 +31,14 @@ jobs:
3131
- "fused-ops-and-kernels"
3232
- "attention-and-distributed-packing"
3333
- "accelerated-moe"
34+
- "online-data-mixing"
3435

3536
steps:
3637
- uses: actions/checkout@v4
37-
- name: Set up Python 3.9
38+
- name: Set up Python 3.11
3839
uses: actions/setup-python@v4
3940
with:
40-
python-version: 3.9
41+
python-version: 3.11
4142
- name: Install dependencies
4243
run: |
4344
python -m pip install --upgrade pip
@@ -60,10 +61,10 @@ jobs:
6061

6162
steps:
6263
- uses: actions/checkout@v4
63-
- name: Set up Python 3.9
64+
- name: Set up Python 3.11
6465
uses: actions/setup-python@v4
6566
with:
66-
python-version: 3.9
67+
python-version: 3.11
6768
- name: Install dependencies
6869
run: |
6970
python -m pip install --upgrade pip

‎plugins/framework/src/fms_acceleration/constants.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,4 +21,4 @@
2121
# and activated.
2222
# - hence the plugins that have model loaders should be on top of this list
2323

24-
PLUGINS = ["peft", "foak", "aadp", "moe"]
24+
PLUGINS = ["peft", "foak", "aadp", "moe", "odm"]

‎plugins/online-data-mixing/.isort.cfg‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
[settings]
2+
profile=black
3+
from_first=true
4+
import_heading_future=Future
5+
import_heading_stdlib=Standard
6+
import_heading_thirdparty=Third Party
7+
import_heading_firstparty=First Party
8+
import_heading_localfolder=Local
9+
known_firstparty=
10+
known_localfolder=tuning

0 commit comments

Comments
 (0)