Skip to content

Commit 8484c1d

Browse files
authored
fix(docs): adjust parameters in the quickstart nemo fw example (#629)
Signed-off-by: Marta Stepniewska-Dziubinska <martas@nvidia.com>
1 parent 3d679ad commit 8484c1d

File tree

1 file changed

+9
-1
lines changed

1 file changed

+9
-1
lines changed

docs/get-started/_snippets/nemo_fw_basic.py

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@
2020
from nemo_evaluator.api import evaluate
2121
from nemo_evaluator.api.api_dataclasses import (
2222
ApiEndpoint,
23+
ConfigParams,
2324
EvaluationConfig,
2425
EvaluationTarget,
2526
)
@@ -31,7 +32,14 @@
3132
model_id="megatron_model",
3233
)
3334
target = EvaluationTarget(api_endpoint=api_endpoint)
34-
config = EvaluationConfig(type="gsm8k", output_dir="results")
35+
config = EvaluationConfig(
36+
type="gsm8k",
37+
output_dir="results",
38+
# Remove limit_samples for running on full dataset
39+
params=ConfigParams(
40+
limit_samples=10, temperature=0, top_p=0, parallelism=1, request_timeout=300
41+
),
42+
)
3543

3644
# Run evaluation
3745
results = evaluate(target_cfg=target, eval_cfg=config)

0 commit comments

Comments
 (0)