Skip to content

Commit e782747

Browse files
committed
Updated benchmarks results
1 parent 88caceb commit e782747

File tree

1 file changed

+9
-9
lines changed

1 file changed

+9
-9
lines changed

README.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -31,9 +31,9 @@ Carquet is **not** a replacement for Apache Arrow. Arrow is the industry standar
3131
| Dependencies | Many (Boost, etc.) | **zstd + zlib only** |
3232
| Binary size | ~50MB+ | **~200KB** |
3333
| Write speed (ARM) | Baseline | **1.5-5x faster** |
34-
| Write speed (x86) | Baseline | ~same |
34+
| Write speed (x86) | Baseline | **1.2-1.4x faster** |
3535
| Read speed (ARM) | Baseline | ~same to 1.3x faster |
36-
| Read speed (x86) | **Baseline** | 2-3x slower |
36+
| Read speed (x86) | **Baseline** | 1.5-2x slower |
3737
| ZSTD file size | Baseline | **~1.4x smaller** |
3838
| Nested types | **Full support** | Basic |
3939
| Encryption | **Yes** | No |
@@ -896,25 +896,25 @@ Carquet's performance varies by platform and use case. These benchmarks show whe
896896

897897
| Codec | Carquet | PyArrow | Speedup |
898898
|-------|---------|---------|---------|
899-
| UNCOMPRESSED | 4.6 M rows/sec | 4.1 M rows/sec | **1.14x faster** |
900-
| SNAPPY | 3.6 M rows/sec | 3.8 M rows/sec | ~same |
901-
| ZSTD | 3.8 M rows/sec | 3.5 M rows/sec | **1.09x faster** |
899+
| UNCOMPRESSED | 5.6 M rows/sec | 4.0 M rows/sec | **1.40x faster** |
900+
| SNAPPY | 4.6 M rows/sec | 3.8 M rows/sec | **1.22x faster** |
901+
| ZSTD | 4.1 M rows/sec | 3.5 M rows/sec | **1.17x faster** |
902902

903903
#### Reading (PyArrow Faster)
904904

905905
| Codec | Carquet | PyArrow | Ratio |
906906
|-------|---------|---------|-------|
907-
| UNCOMPRESSED | 27 M rows/sec | 65 M rows/sec | 0.42x slower |
908-
| SNAPPY | 21 M rows/sec | 51 M rows/sec | 0.41x slower |
909-
| ZSTD | 19 M rows/sec | 49 M rows/sec | 0.39x slower |
907+
| UNCOMPRESSED | 35 M rows/sec | 67 M rows/sec | 0.53x slower |
908+
| SNAPPY | 36 M rows/sec | 53 M rows/sec | 0.67x slower |
909+
| ZSTD | 26 M rows/sec | 49 M rows/sec | 0.52x slower |
910910

911911
#### Compression Ratio
912912

913913
| Codec | Carquet | PyArrow | Ratio |
914914
|-------|---------|---------|-------|
915915
| ZSTD | 108 MB | 148 MB | **1.37x smaller** |
916916
| SNAPPY | 191 MB | 173 MB | 1.10x larger |
917-
| UNCOMPRESSED | 191 MB | 199 MB | 1.04x smaller |
917+
| UNCOMPRESSED | 191 MB | 199 MB | 1.05x smaller |
918918

919919
### Running Benchmarks
920920

0 commit comments

Comments
 (0)