File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -10,8 +10,8 @@ Proof of concept:
1010
1111``` sh
1212export model_name=llama_3.2-1b && export quantization=f32
13- ./build/bin/finetune --file wikitext-2-raw/wiki.test.raw -ngl 999 --model models/${model_name} -${quantization} .gguf -c 512 -b 512 -ub 512
14- ./build/bin/perplexity --file wikitext-2-raw/wiki.test.raw -ngl 999 --model finetuned-model.gguf
13+ ./build/bin/llama- finetune --file wikitext-2-raw/wiki.test.raw -ngl 999 --model models/${model_name} -${quantization} .gguf -c 512 -b 512 -ub 512
14+ ./build/bin/llama- perplexity --file wikitext-2-raw/wiki.test.raw -ngl 999 --model finetuned-model.gguf
1515```
1616
1717The perplexity value of the finetuned model should be lower after training on the test set for 2 epochs.
You can’t perform that action at this time.
0 commit comments