Add cstdint to tokenizer (missing include) (#1339)

byjlw · Jesse · Jack-Khuu · vmpuri · commit a286e58b2b6b · 2025-02-04T13:50:16.000-08:00
* toeknizer was missing an include

* fix a nit

---------

Co-authored-by: Jesse &lt;jesse@byjlw.com&gt;
Co-authored-by: Jack-Khuu &lt;jack.khuu.7@gmail.com&gt;
diff --git a/tokenizer/base64.h b/tokenizer/base64.h
@@ -25,6 +25,7 @@
 #pragma once
 
 #include <cassert>
+#include <cstdint>
 #include <string>
 #include <string_view>
 
