Add cstdint to tokenizer (missing include) (pytorch#1339)

byjlw · Jesse · Jack-Khuu · web-flow · commit fe257fdb0c91 · 2024-11-12T17:10:23.000-08:00
* toeknizer was missing an include

* fix a nit

---------

Co-authored-by: Jesse &lt;jesse@byjlw.com&gt;
Co-authored-by: Jack-Khuu &lt;jack.khuu.7@gmail.com&gt;
diff --git a/tokenizer/base64.h b/tokenizer/base64.h
@@ -25,6 +25,7 @@
 #pragma once
 
 #include <cassert>
+#include <cstdint>
 #include <string>
 #include <string_view>
 
