Skip to content

Spacy Misaligned Entities Β #11497

@ambuje

Description

@ambuje

Hi All,

This is regarding:-

"UserWarning: [W030] Some entities could not be aligned in the text "はい . γ‚·γƒžγƒ γƒ© ヒロユキ 様 、 本ζ—₯ は γ‚γ‚ŠγŒγ¨γ† ござい ます ." with entities "[(5, 13, 'PERSON')]". Use spacy.gold.biluo_tags_from_offsets(nlp.make_doc(text), entities) to check the alignment. Misaligned entities (with BILUO tag '-') will be ignored during training."

Is it possible to get all the misaligned data points in a form of a list? So that one can go through each text and correct this warning.

Thank you,

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions