Bump tokenizers to incorporate new features for HF tokenizer (#11995)

larryliu0820 · web-flow · commit 55c8b8d5aea2 · 2025-06-26T15:32:59.000-07:00
To incorporate changes in meta-pytorch/tokenizers#87, so that we can run gemma-3.
diff --git a/extension/llm/tokenizers b/extension/llm/tokenizers
@@ -1 +1 @@
-Subproject commit ffd2973e8879f64c78f01a3f4aa0f77bdc5a1abe
+Subproject commit d202b36fe006457c2139a423ef183ca4ce7c410c
