Performance by category in rel_component

[rjaas]

I have successfully trained a relation extractor according to the tutorial. However, when I trained a NER model, meta.json reported performance for each Named Entity category (e.g Person, Time), whilst the custom relation extractor does not.

How can I get precision, recall and f-score per relationship category when training the custom relation extractor?

[polm]

The REL component doesn't have an option for that, you'd need to customize the scoring function.