[llava] Add tiktoken dep (#5608)

pytorchbot · jackzhxng · web-flow · commit 7f8ea4416663 · 2024-09-24T14:22:31.000-07:00
Add tiktoken dep (#5586) Summary: Pull Request resolved: #5586 Reviewed By: larryliu0820 Differential Revision: D63331756 Pulled By: dvorjackz fbshipit-source-id: b17d1cafabd7dfd1902a5fe1b6fb02ae06f2b847 (cherry picked from commit 72245c3) Co-authored-by: Jack Zhang <dvorjackz@gmail.com>
diff --git a/examples/models/llava/install_requirements.sh b/examples/models/llava/install_requirements.sh
@@ -7,6 +7,6 @@
 
 set -x
 
-pip install transformers accelerate sentencepiece
+pip install transformers accelerate sentencepiece tiktoken
 
 pip list
