Skip to content

Commit 6a2e749

Browse files
update inference request example in Fine-Tune Llama3 notebook to use fine-tuned model
Signed-off-by: aishwarya.raimule <aishwarya.raimule@nutanix.com>
1 parent bc70c68 commit 6a2e749

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/pytorch/text-classification/Fine-Tune-Llama3-LLM.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -367,7 +367,7 @@
367367
"source": [
368368
"# ! curl --location 'http://localhost:8083/openai/v1/chat/completions' \\\n",
369369
"# --header 'Content-Type: application/json' \\\n",
370-
"# --data '{ \"model\": \"llama-3-1-8b-kubecon\", \"messages\": [{ \"role\": \"user\", \"content\": \"Can you tell me when is KubeCon + CloudNativeCon India 2024 scheduled?\"}], \"max_tokens\": 200, \"stream\": false}' | grep -o '\"content\":\"[^\"]*\"' \\\n",
370+
"# --data '{ \"model\": \"llama-3-1-8b-finetuned\", \"messages\": [{ \"role\": \"user\", \"content\": \"Recommend a good Japanese restaurant in Arizona.\"}], \"max_tokens\": 200, \"stream\": false}' | grep -o '\"content\":\"[^\"]*\"' \\\n",
371371
"# | sed 's/\"content\":\"\\(.*\\)\"/\\1/'"
372372
]
373373
}

0 commit comments

Comments
 (0)