bump tokenizers to main (#3412)

babusid · web-flow · commit 4e2c442afce8 · 2026-01-28T11:59:30.000-05:00
Updates Tokenizers Submodule to most recent commit.
Earlier versions had an issue with CMAKE 4.2+ versions.
Should build from source properly on newer versions now.
diff --git a/3rdparty/tokenizers-cpp b/3rdparty/tokenizers-cpp
@@ -1 +1 @@
-Subproject commit 55d53aa38dc8df7d9c8bd9ed50907e82ae83ce66
+Subproject commit 34885cfd7b9ef27b859c28a41e71413dd31926f5
