Using entity specific custom features in NER #10894
Unanswered
mapadofu
asked this question in
Help: Coding & Implementations
Replies: 1 comment
-
What you may be remembering is that you can customize the attributes used in the The default tok2vec only supports Token attributes (the ones here). You can implement a custom tok2vec layer to use arbitrary information, though it's a little more complicated, and will be slower. You can see an example of someone doing that here). |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Generically, is there a way to use additional/custom features as inputs to NER model? I vaguely recall that earlier versions of the software did support this and how to do it was described in the documentation. However I haven't been able to locate this in the current version.
Specifically, I've got some custom entity types similar to serial numbers. I can flag most instances of them using a rule-based matcher, and could use that matcher to set custom attributes on the token that would indicate "this token 'looks like' a serial number". The idea would be to incorporate these highly informative features into the NER model that I plan on training on the relevant dataset.
Beta Was this translation helpful? Give feedback.
All reactions