Skip to content
Discussion options

You must be logged in to vote

The models are loaded in memory, so the speed for running a text through a pipeline shouldn't depend on disk access.

If everything else is identical, double-check that you have the exact same versions of all the dependencies, in particular blis, where you may notice a big difference in speed on newer CPUs (v0.4.x vs. v0.7.x).

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@bissana
Comment options

Answer selected by bissana
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat / serialize Feature: Serialization, saving and loading perf / speed Performance: speed
2 participants