We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent ca6d9cf commit 4b38e3dCopy full SHA for 4b38e3d
README.md
@@ -107,6 +107,7 @@ uv run --group automodel torchrun --nproc-per-node=8 \
107
108
- **AutoModel Path**
109
- 🌐 PyTorch DTensor-native SPMD training
110
+ - 🚀 Advanced parallelisms (TP, PP, etc.) coming soon!
111
- 🔀 FSDP2-based Hybrid Sharding Data Parallelism (HSDP)
112
- 📦 Sequence packing for efficient training
113
- 🎨 Minimal ceremony with YAML-driven configs
0 commit comments