Skip to content

Commit b206439

Browse files
authored
[TorchComms] Update readme (#1917)
Async TP is not working, add into readme
1 parent 1587868 commit b206439

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

torchtitan/experiments/torchcomms/README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,8 @@ Locally tested with:
4646

4747
### Known Issues
4848

49-
- **CP** (Context Parallelism) - Temporly not working
49+
- **CP** (Context Parallelism) - Temporarily not working. Work in progress.
50+
- **Async TP** - Temporarily not working. Work in progress.
5051
- **Memory Overhead** - TorchComms requires higher peak memory usage. As a workaround, we need to reduce `local_batch_size` to avoid out of memory error.
5152

5253
## Roadmap

0 commit comments

Comments
 (0)