Add tiktoken dep (#5586)

jackzhxng · facebook-github-bot · commit 72245c3310e7 · 2024-09-24T12:35:54.000-07:00
Summary: Pull Request resolved: #5586 Reviewed By: larryliu0820 Differential Revision: D63331756 Pulled By: dvorjackz fbshipit-source-id: b17d1cafabd7dfd1902a5fe1b6fb02ae06f2b847
diff --git a/examples/models/llava/install_requirements.sh b/examples/models/llava/install_requirements.sh
@@ -7,6 +7,6 @@
 
 set -x
 
-pip install transformers accelerate sentencepiece
+pip install transformers accelerate sentencepiece tiktoken
 
 pip list
