Skip to content

Commit 4b2d034

Browse files
committed
Fix comments.
Signed-off-by: congw729 <[email protected]>
1 parent 4cbc75c commit 4b2d034

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

InterVL/InterVL3.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ uv pip install -U vllm --torch-backend auto
1515
```
1616

1717
### Weights
18-
[OpenGVLab/InternVL3-8B-hf](https://huggingface.co/OpenGVLab/InternVL3-8B)
18+
[OpenGVLab/InternVL3-8B-hf](https://huggingface.co/OpenGVLab/InternVL3-8B-hf)
1919

2020
### Running InternVL3-8B-hf model on A100-SXM4-40GB GPUs (2 cards) in eager mode
2121

@@ -31,7 +31,7 @@ vllm serve OpenGVLab/InternVL3-8B-hf --enforce-eager \
3131

3232
## Configs and Parameters
3333

34-
`--enforce-eager` disables the CUDA Graph in PyTorch; otherwise, it will throw error `torch._dynamo.exc.Unsupported: Data-dependent branching` during testing. For more information about CUDA Graph, please check [Accelerating-pytorch-with-cuda-graphs](https://pytorch.org/blog/accelerating-pytorch-with-cuda-graphs/)
34+
`--enforce-eager` disables the CUDA Graph in PyTorch; otherwise, it will throw error `torch._dynamo.exc.Unsupported: Data-dependent branching` during testing. For more information about CUDA Graph, please check [Accelerating-pytorch-with-cuda-graphs](https://pytorch.org/blog/accelerating-pytorch-with-cuda-graphs/)
3535

3636
`--tensor-parallel-size` sets Tensor Parallel (TP).
3737

0 commit comments

Comments
 (0)