From 4750cc9fd900402714484755f2c6a10d86608e4f Mon Sep 17 00:00:00 2001
From: Mengwei Liu <larryliu@meta.com>
Date: Wed, 25 Jun 2025 21:43:05 -0700
Subject: [PATCH] Bump tokenizers to incorporate new features for HF tokenizer

---
 extension/llm/tokenizers | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/extension/llm/tokenizers b/extension/llm/tokenizers
index ffd2973e887..d202b36fe00 160000
--- a/extension/llm/tokenizers
+++ b/extension/llm/tokenizers
@@ -1 +1 @@
-Subproject commit ffd2973e8879f64c78f01a3f4aa0f77bdc5a1abe
+Subproject commit d202b36fe006457c2139a423ef183ca4ce7c410c