Skip to content

Commit 9ce97bf

Browse files
allenwang28Allen Wang
andauthored
Adds scripts and instructions for installing Forge from source. (#98)
* commit the install stuff * ld lib path * fix install.sh * remove torchao again * a few more fixes * install forge as editable --------- Co-authored-by: Allen Wang <[email protected]>
1 parent 7357daa commit 9ce97bf

File tree

12 files changed

+587
-6
lines changed

12 files changed

+587
-6
lines changed

.github/workflows/unit_test.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ jobs:
2626
- name: Install pytorch
2727
run: python -m pip install torch==2.9.0.dev20250826 --extra-index-url https://download.pytorch.org/whl/nightly/cpu
2828
- name: Install monarch
29-
run: python -m pip install monarch-no-torch==0.1.0.dev20250826 --find-links assets/wheels
29+
run: python -m pip install monarch-no-torch==0.1.0.dev20250826 --find-links assets/ci
3030
- name: Install dependencies
3131
run: python -m pip install --no-build-isolation -e ".[dev]"
3232
- name: Run unit tests with coverage

.gitignore

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -187,3 +187,5 @@ cover/
187187

188188
# wandb
189189
wandb/
190+
191+
assets/wheels/vllm*.whl

README.md

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,34 @@
66

77
## Installation
88

9+
### Basic
10+
11+
Forge requires the latest PyTorch nightly with Monarch, vLLM, and torchtitan. For convenience,
12+
we have pre-packaged these dependencies as wheels in assets/wheels.
13+
14+
To install Forge easily:
15+
16+
```bash
17+
conda create -n forge python=3.10
18+
./scripts/install.sh
19+
```
20+
21+
You can test with
22+
```
23+
python -m apps.grpo.main
24+
```
25+
26+
If you need to re-build the wheels for whatever reason, you can do so with:
27+
```bash
28+
conda create -n forge python=3.10
29+
./scripts/build_wheels.sh
30+
```
31+
32+
Since the vLLM wheel is too large for GitHub, we uploaded it as a release:
33+
```
34+
$ gh release create v0.0.0 assets/wheels/vllm-*.whl --title "Forge Wheels v0.0.0"
35+
```
36+
937
### Basic (Broken)
1038

1139
```bash

apps/sft_v2/llama3_8b.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ processes:
2020
scheduler: local # local | mast (not supported yet)
2121
num_hosts: 1
2222
num_procs: 8
23-
num_gpus: 8
23+
with_gpus: true
2424

2525
optimizer:
2626
name: AdamW
31.9 MB
Binary file not shown.
7.29 KB
Binary file not shown.
389 KB
Binary file not shown.

pyproject.toml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,6 @@ dependencies = [
1313
# PyTorch
1414
"torchdata>=0.8.0",
1515
"torchtitan",
16-
"torchao",
1716
# vLLM
1817
# TODO: pin specific vllm version
1918
#"vllm==0.10.0",

0 commit comments

Comments
 (0)