Skip to content
Discussion options

You must be logged in to vote

Hi, it looks like something has gone wrong with your data conversion. It looks like every single word thinks it's the head of its own one-word sentence:

Found 452495 sentence(s) with an average length of 1.0 words.

My guess would be that the token.head values weren't set correctly in your conversion?

Replies: 1 comment 3 replies

Comment options

You must be logged in to vote
3 replies
@tohidmonjazeb
Comment options

@adrianeboyd
Comment options

@tohidmonjazeb
Comment options

Answer selected by tohidmonjazeb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat / training Feature: Training utils, Example, Corpus and converters
2 participants
Converted from issue

This discussion was converted from issue #9745 on November 26, 2021 08:14.