"number" still not in spacy's vocab #10123
-
There's a relevant issue here, but "number" doesn't seem to be in spacy's vocab? #2561 How to reproduce the behaviour
Your Environment
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
The particular way you're checking this returning false is a quirk of the implementation of the string store. "number" is one of the strings stored as a symbol, which means it is stored in a special way and won't come up if you iterate over the keys in the string store. On the other hand this is True:
I didn't address this last time because the issue just seemed resolved either way, but can you clarify why this is a problem for you? The string store is an implementation detail and the presence or absence of strings in it is basically arbitrary - it shouldn't be used to check if something is OOV or anything. |
Beta Was this translation helpful? Give feedback.
The particular way you're checking this returning false is a quirk of the implementation of the string store. "number" is one of the strings stored as a symbol, which means it is stored in a special way and won't come up if you iterate over the keys in the string store. On the other hand this is True:
I didn't address this last time because the issue just seemed resolved either way, but can you clarify why this is a problem for you? The string store is an implementation detail and the presence or absence of strings in it is basically arbitrary - it shouldn't be used to check if something is OOV …