From cd1234cf790d0645428f8095dae0afa06eabc735 Mon Sep 17 00:00:00 2001 From: "dependabot[bot]" <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon, 16 Jun 2025 21:10:55 +0000 Subject: [PATCH] build(deps): bump tokenizers from 0.19.1 to 0.21.1 Bumps [tokenizers](https://github.com/huggingface/tokenizers) from 0.19.1 to 0.21.1. - [Release notes](https://github.com/huggingface/tokenizers/releases) - [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md) - [Commits](https://github.com/huggingface/tokenizers/compare/v0.19.1...v0.21.1) --- updated-dependencies: - dependency-name: tokenizers dependency-version: 0.21.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] --- docs/requirements-docs.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/requirements-docs.txt b/docs/requirements-docs.txt index 49ecc0a..f4d2e54 100644 --- a/docs/requirements-docs.txt +++ b/docs/requirements-docs.txt @@ -9,4 +9,4 @@ sphinx-markdown-tables sphinx-rtd-theme # pin tokenizers version to avoid env_logger version req -tokenizers==0.19.1 +tokenizers==0.21.1