Skip to content

Commit c32517b

Browse files
Update tools/benchmarks/llm_eval_harness/meta_eval_reproduce/README.md
Co-authored-by: Hamid Shojanazeri <[email protected]>
1 parent f4d50d5 commit c32517b

File tree

1 file changed

+0
-1
lines changed
  • tools/benchmarks/llm_eval_harness/meta_eval_reproduce

1 file changed

+0
-1
lines changed

tools/benchmarks/llm_eval_harness/meta_eval_reproduce/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@ As Meta Llama models gain popularity, evaluating these models has become increas
55

66
## Disclaimer
77

8-
### Important Notes
98

109
1. **This tutorial is not the official implementation** of Meta Llama evaluation. It is based on public third-party libraries, and the implementation may differ slightly from our internal evaluation, leading to minor differences in the reproduced numbers.
1110
2. **Model Compatibility**: This tutorial is specifically for Llama 3 based models, as our prompts include Meta Llama 3 special tokens, e.g. `<|start_header_id|>user<|end_header_id|>`. It will not work with models that are not based on Llama 3.

0 commit comments

Comments
 (0)