Skip to content

Commit 29d74f7

Browse files
committed
chore: add comment explaining why 128 bytes for capacity
1 parent 0b19208 commit 29d74f7

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

pandas/_libs/src/parser/tokenizer.c

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,8 @@ GitHub. See Python Software Foundation License and BSD licenses for these.
2828
#include "pandas/portable.h"
2929
#include "pandas/vendored/klib/khash.h" // for kh_int64_t, kh_destroy_int64
3030

31+
// Arrow256 allows up to 76 decimal digits.
32+
// We rounded up to the next power of 2.
3133
#define PROCESSED_WORD_CAPACITY 128
3234

3335
void coliter_setup(coliter_t *self, parser_t *parser, int64_t i,

0 commit comments

Comments
 (0)