Skip to content

Commit 9d3923d

Browse files
fixed the datasets duplication
1 parent 3b4f051 commit 9d3923d

File tree

5 files changed

+4
-5
lines changed

5 files changed

+4
-5
lines changed

inference/trillium/vLLM/Llama3-8b/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,7 +116,7 @@ curl http://localhost:8000/v1/completions \
116116
You might need to install datasets as it's not available in the base vllm image.
117117

118118
```bash
119-
pip install datasets datasets
119+
pip install datasets
120120
```
121121

122122
## Step 10: Run the benchmarking

inference/trillium/vLLM/Qwen2.5-32B/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,7 +116,7 @@ curl http://localhost:8000/v1/completions \
116116
You might need to install datasets as it's not available in the base vllm image.
117117

118118
```bash
119-
pip install datasets datasets
119+
pip install datasets
120120
```
121121

122122
## Step 10: Run the benchmarking

inference/v5e/vLLM/Llama3-8b/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ curl http://localhost:8000/v1/completions \
118118
You might need to install datasets as it's not available in the base vllm image.
119119

120120
```bash
121-
pip install datasets datasets
121+
pip install datasets
122122
```
123123

124124
## Step 10: Run the benchmarking

inference/v5e/vLLM/Qwen2.5-32B/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ curl http://localhost:8000/v1/completions \
118118
You might need to install datasets as it's not available in the base vllm image.
119119

120120
```bash
121-
pip install datasets datasets
121+
pip install datasets
122122
```
123123

124124
## Step 10: Run the benchmarking

inference/v5e/vLLM/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,4 +10,3 @@ These models were chosen for demonstration purposes only. You can serve any mode
1010
If you are looking for GKE-based deployment, please refer to this documentation: [Serve an LLM using TPU Trillium on GKE with vLLM](https://cloud.google.com/kubernetes-engine/docs/tutorials/serve-vllm-tpu)
1111

1212
To serve vLLM on v6e TPUs, please refer to this page: [Serve vLLM on Trillium TPUs (v6e)](../../trillium/vLLM/README.md)
13-

0 commit comments

Comments
 (0)