Skip to content

Commit fd7caad

Browse files
committed
Update README
1 parent e061c09 commit fd7caad

File tree

1 file changed

+4
-6
lines changed

1 file changed

+4
-6
lines changed

README.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -198,20 +198,18 @@ openpi now provides PyTorch implementations of π₀ and π₀.₅ models alongs
198198
- EMA (exponential moving average) weights during training
199199

200200
### Setup
201-
1. Make sure that you have the latest version of all dependencies installed:
202-
```bash
203-
uv sync
204-
```
201+
1. Make sure that you have the latest version of all dependencies installed: `uv sync`
205202

206203
2. Double check that you have transformers 4.53.2 installed: `uv pip show transformers`
207204

208205
3. Apply the transformers library patches:
209206
```bash
210207
cp -r ./src/openpi/models_pytorch/transformers_replace/* .venv/lib/python3.11/site-packages/transformers/
211208
```
212-
This overwrites several files in the transformers library with necessary model changes.
213209

214-
**WARNING**: With the default uv link mode (hardlink), this will permanently affect the transformers library in your uv cache. To fully undo this operation, you must run `uv cache clean transformers`.
210+
This overwrites several files in the transformers library with necessary model changes: 1) supporting AdaRMS, 2) correctly controlling the precision of activations, and 3) allowing the KV cache to be used without being updated.
211+
212+
**WARNING**: With the default uv link mode (hardlink), this will permanently affect the transformers library in your uv cache, meaning the changes will survive reinstallations of transformers and could even propagate to other projects that use transformers. To fully undo this operation, you must run `uv cache clean transformers`.
215213

216214
### Converting JAX Models to PyTorch
217215

0 commit comments

Comments
 (0)