feat: integrate fastokens BPE tokenizer backend #30350

Job	Run time
changed-files	12s
pre-commit	41s
rust-tests (lib/bindings/python)	5m 48s
rust-clippy (lib/bindings/kvbm)	21s
rust-clippy (lib/bindings/python)	24s
rust-clippy (lib/runtime/examples)	25s
rust-clippy (.)	20s
rust-tests (lib/runtime/examples)	2m 56s
rust-tests (lib/bindings/kvbm)	5m 52s
rust-tests (.)	11m 16s
pre-merge-status-check	3s
	28m 18s

Provide feedback