Skip to content
Discussion options

You must be logged in to vote

Solved: the problem was indexing.

In the example given in the docs, the token following the ellipsis should start the new sentence, whereas in my example the token itself (YOLO. or YODO.) should start the sentence, hence

    doc[token.i].is_sent_start = True
    doc[token.i + 1].is_sent_start = False

Now it works.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by djmechanic
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat / pipeline Feature: Processing pipeline and components
1 participant