Skip to content

Commit 2620021

Browse files
LLM-as-a-Judge Notebook Clarification, and Doc Link Update (#339)
Signed-off-by: Chris Alexiuk <[email protected]> Co-authored-by: Chris Alexiuk <[email protected]>
1 parent a12d207 commit 2620021

File tree

2 files changed

+5
-3
lines changed

2 files changed

+5
-3
lines changed

nemo/Evaluator/GettingStarted/Getting Started with NeMo Evaluator.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919
"\n",
2020
"Before you begin, you will need to make sure you're in an environment where you have API access to Nemo Evaluator API, baseline model NIM, the customized model NIM, and a judge LLM NIM.\n",
2121
"\n",
22-
"For instructions on the above, please check out the detailed [Nemo Evaluator deployment guide](https://developer.nvidia.com/docs/nemo-microservices/evaluation/source/deploy-helm.html), and the [NIM deployment guide](https://developer.nvidia.com/docs/nemo-microservices/inference/getting_started/deploy-helm.html)."
22+
"For instructions on the above, please check out the detailed [Nemo Evaluator deployment guide](https://docs.nvidia.com/nemo/microservices/latest/set-up/deploy-as-microservices/evaluator/parent-chart.html), and the [NIM deployment guide](https://developer.nvidia.com/docs/nemo-microservices/inference/getting_started/deploy-helm.html)."
2323
]
2424
},
2525
{

nemo/Evaluator/LLMAsAJudge/LLM As a Judge.ipynb

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -93,7 +93,9 @@
9393
"cell_type": "markdown",
9494
"metadata": {},
9595
"source": [
96-
"### Upload dataset to NeMo Datastore"
96+
"### Upload dataset to NeMo Datastore\n",
97+
"\n",
98+
"> NOTE: Your `DATASTORE_URL` should be in the format: `http://localhost:3000`."
9799
]
98100
},
99101
{
@@ -112,7 +114,7 @@
112114
"repo_type = \"dataset\"\n",
113115
"dir_path = \"./llm_as_a_judge\"\n",
114116
"\n",
115-
"hf_api = hh.HfApi(endpoint=DATASTORE_URL, token=token)\n",
117+
"hf_api = hh.HfApi(endpoint=f\"{DATASTORE_URL}/v1/hf\", token=token)\n",
116118
"\n",
117119
"# create repo\n",
118120
"hf_api.create_repo(\n",

0 commit comments

Comments
 (0)