From fefa90a41d455fdb502c1fd473f26820dc3711f4 Mon Sep 17 00:00:00 2001 From: Philipp Schmid <32632186+philschmid@users.noreply.github.com> Date: Mon, 9 Sep 2024 15:40:31 +0200 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0a19a8cc..596f7064 100644 --- a/README.md +++ b/README.md @@ -62,7 +62,7 @@ GuideLLM requires an OpenAI-compatible server to run evaluations. [Text Generati ```bash docker run --gpus 1 -ti --shm-size 1g --ipc=host --rm -p 8080:80 \ - -e MODEL_ID=https://huggingface.co/llhf/Meta-Llama-3.1-8B-Instruct \ + -e MODEL_ID=meta-llama/Meta-Llama-3.1-8B-Instruct \ -e NUM_SHARD=1 \ -e MAX_INPUT_TOKENS=4096 \ -e MAX_TOTAL_TOKENS=6000 \