Perplexity scores #401
Unanswered
emarcus255
asked this question in
Q&A
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi.
I am trying to calculate perplexity scores on my data set using marian-scorer and to be honest I am not sure if I am doing it correctly and if the scores returned by marian-scorer are the right one.
marian-scorer -m model/model.npz -v model/spm-src.spm model/spm-trg.spm -t data/source.test.src data/source.test.trg > marian_psppl.scoreI know in the --summary parameter I can pass what type of score to get but what actually scores I am getting for each sentence of my data set (without passing the summary option)? The scores I am getting have all negative value what makes me wonder if they are correct.
Beta Was this translation helpful? Give feedback.
All reactions