Skip to content

Commit 8230348

Browse files
committed
doc: update example sigma rel
1 parent 41160c6 commit 8230348

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

README.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,10 @@ Choose your EMA decay rate after training. No need to decide upfront.
55
The library uses `sigma_rel` (relative standard deviation) to parameterize EMA decay rates, which relates to the classical EMA decay rate `beta` as follows:
66

77
```python
8-
beta = 0.9999 # Very slow decay -> sigma_rel ≈ 0.05
9-
beta = 0.999 # Medium decay -> sigma_rel ≈ 0.15
10-
beta = 0.99 # Fast decay -> sigma_rel ≈ 0.28
8+
beta = 0.9999 # Very slow decay -> sigma_rel ≈ 0.01
9+
beta = 0.9990 # Slow decay -> sigma_rel ≈ 0.03
10+
beta = 0.9900 # Medium decay -> sigma_rel ≈ 0.10
11+
beta = 0.9000 # Fast decay -> sigma_rel ≈ 0.27
1112
```
1213

1314
This library was adapted from [ema-pytorch](https://github.com/lucidrains/ema-pytorch) by lucidrains.

0 commit comments

Comments
 (0)