Is there a loading progress indicator during nlp tokenization? #12117
Answered
by
adrianeboyd
nhershy
asked this question in
Help: Coding & Implementations
-
I am loading the contents of entire books into the NLP object. For the last book (which was a text file of about 1MB and 960,000 chars), it took around 20 minutes or so to finish tokenizing. I will be needing to load even larger files. How can I get some type of indicator that shows percentage complete while the tokenizing process is ongoing? That way I can get a rough estimate of the times required. input = loadBook(FILE_PATH)
print("Tokenizing Words...")
tokens = nlp(input) # Want to show current progress from this action here
print("Tokenizing Complete!") |
Beta Was this translation helpful? Give feedback.
Answered by
adrianeboyd
Jan 18, 2023
Replies: 1 comment 2 replies
-
Let me back up a step and ask a few questions for clarification:
General comments:
|
Beta Was this translation helpful? Give feedback.
2 replies
Answer selected by
polm
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Let me back up a step and ask a few questions for clarification:
nlp
?General comments: