Skip to content

Commit b79a8f9

Browse files
committed
add doc
1 parent d21fd29 commit b79a8f9

File tree

2 files changed

+4
-0
lines changed

2 files changed

+4
-0
lines changed

docs/sphinx_doc/source/tutorial/trinity_configs.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -475,6 +475,7 @@ trainer:
475475
use_dynamic_bsz: true
476476
max_token_len_per_gpu: 16384
477477
ulysses_sequence_parallel_size: 1
478+
max_checkpoints_to_keep: 5
478479
trainer_config: null
479480
```
480481

@@ -499,6 +500,7 @@ trainer:
499500
- `use_dynamic_bsz`: Whether to use dynamic batch size.
500501
- `max_token_len_per_gpu`: The maximum number of tokens to be processed in forward and backward when updating the policy. Effective when `use_dynamic_bsz=true`.
501502
- `ulysses_sequence_parallel_size`: Sequence parallel size.
503+
- `max_checkpoints_to_keep`: Maximum number of checkpoints to keep. Older checkpoints will be deleted. If not specified, all checkpoints will be kept.
502504
- `trainer_config`: The trainer configuration provided inline.
503505
---
504506

docs/sphinx_doc/source_zh/tutorial/trinity_configs.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -472,6 +472,7 @@ trainer:
472472
use_dynamic_bsz: true
473473
max_token_len_per_gpu: 16384
474474
ulysses_sequence_parallel_size: 1
475+
max_checkpoints_to_keep: 5
475476
trainer_config: null
476477
```
477478

@@ -496,6 +497,7 @@ trainer:
496497
- `use_dynamic_bsz`: 是否使用动态批量大小。
497498
- `max_token_len_per_gpu`: 训练过程中,每个 GPU 最大 token 长度; 当 `use_dynamic_bsz=true` 时生效。
498499
- `ulysses_sequence_parallel_size`: 序列并行的并行度,即用于分割单个序列的 GPU 数量。
500+
- `max_checkpoints_to_keep`: 保留的最大检查点数量。超过此数量后,最旧的检查点将被删除。
499501
- `trainer_config`: 内联提供的 trainer 配置。
500502

501503
---

0 commit comments

Comments
 (0)