Skip to content

Commit b501d71

Browse files
committed
Update tokenizers
1 parent 3335e22 commit b501d71

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

.github/workflows/pr_test_peft_backend.yml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -96,10 +96,11 @@ jobs:
9696
if [ "${{ matrix.lib-versions }}" == "main" ]; then
9797
python -m pip install -U peft@git+https://github.com/huggingface/peft.git --no-deps
9898
python -m uv pip install -U transformers@git+https://github.com/huggingface/transformers.git --no-deps
99+
python -m uv pip install -U tokenizers@git+https://github.com/huggingface/tokenizers.git --no-deps
99100
pip uninstall accelerate -y && python -m uv pip install -U accelerate@git+https://github.com/huggingface/accelerate.git --no-deps
100101
else
101102
python -m uv pip install -U peft --no-deps
102-
python -m uv pip install -U transformers accelerate --no-deps
103+
python -m uv pip install -U transformers accelerate tokenizers --no-deps
103104
fi
104105
105106
- name: Environment

0 commit comments

Comments
 (0)