What should be the vocabulary size for a blank model? #10022
-
|
I am loading a blank model. When I am checking the vocabulary length, it shows a non-zero value. Why is it so? Shouldn't it display 0? Here is the code and the output:
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Blank Vocabs are initialized with some strings, like labels used for dependency parsing. The length of a Vocab (or the strings in it) is basically an implementation detail, and shouldn't be relied on to count the words a model has seen or something. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the explanation. |
Beta Was this translation helpful? Give feedback.
Blank Vocabs are initialized with some strings, like labels used for dependency parsing.
The length of a Vocab (or the strings in it) is basically an implementation detail, and shouldn't be relied on to count the words a model has seen or something.