delta_binary_packed.parquet is generated with parquet-mr version 1.10.0.
The expected file contents are in delta_binary_packed_expect.csv.
Each column is DELTA_BINARY_PACKED-encoded, with a different delta bitwidth for each column.
Each column has 200 rows including 1 first value and 2 blocks. The first block has 4 miniblocks, the second block has 3. Each miniblock contains 32 values, except the last one which only contains 7 values (1 + 6 * 32 + 7 == 200).
Here is the file structure:
File Name: /home/antoine/parquet/testing/data/delta_binary_packed.parquet
Version: 1.0
Created By: parquet-mr version 1.10.0 (build 031a6654009e3b82020012a18434c582bd74c73a)
Total rows: 200
Number of RowGroups: 1
Number of Real Columns: 66
Number of Columns: 66
Number of Selected Columns: 66
Column 0: bitwidth0 (INT64)
Column 1: bitwidth1 (INT64)
Column 2: bitwidth2 (INT64)
Column 3: bitwidth3 (INT64)
Column 4: bitwidth4 (INT64)
Column 5: bitwidth5 (INT64)
Column 6: bitwidth6 (INT64)
Column 7: bitwidth7 (INT64)
Column 8: bitwidth8 (INT64)
Column 9: bitwidth9 (INT64)
Column 10: bitwidth10 (INT64)
Column 11: bitwidth11 (INT64)
Column 12: bitwidth12 (INT64)
Column 13: bitwidth13 (INT64)
Column 14: bitwidth14 (INT64)
Column 15: bitwidth15 (INT64)
Column 16: bitwidth16 (INT64)
Column 17: bitwidth17 (INT64)
Column 18: bitwidth18 (INT64)
Column 19: bitwidth19 (INT64)
Column 20: bitwidth20 (INT64)
Column 21: bitwidth21 (INT64)
Column 22: bitwidth22 (INT64)
Column 23: bitwidth23 (INT64)
Column 24: bitwidth24 (INT64)
Column 25: bitwidth25 (INT64)
Column 26: bitwidth26 (INT64)
Column 27: bitwidth27 (INT64)
Column 28: bitwidth28 (INT64)
Column 29: bitwidth29 (INT64)
Column 30: bitwidth30 (INT64)
Column 31: bitwidth31 (INT64)
Column 32: bitwidth32 (INT64)
Column 33: bitwidth33 (INT64)
Column 34: bitwidth34 (INT64)
Column 35: bitwidth35 (INT64)
Column 36: bitwidth36 (INT64)
Column 37: bitwidth37 (INT64)
Column 38: bitwidth38 (INT64)
Column 39: bitwidth39 (INT64)
Column 40: bitwidth40 (INT64)
Column 41: bitwidth41 (INT64)
Column 42: bitwidth42 (INT64)
Column 43: bitwidth43 (INT64)
Column 44: bitwidth44 (INT64)
Column 45: bitwidth45 (INT64)
Column 46: bitwidth46 (INT64)
Column 47: bitwidth47 (INT64)
Column 48: bitwidth48 (INT64)
Column 49: bitwidth49 (INT64)
Column 50: bitwidth50 (INT64)
Column 51: bitwidth51 (INT64)
Column 52: bitwidth52 (INT64)
Column 53: bitwidth53 (INT64)
Column 54: bitwidth54 (INT64)
Column 55: bitwidth55 (INT64)
Column 56: bitwidth56 (INT64)
Column 57: bitwidth57 (INT64)
Column 58: bitwidth58 (INT64)
Column 59: bitwidth59 (INT64)
Column 60: bitwidth60 (INT64)
Column 61: bitwidth61 (INT64)
Column 62: bitwidth62 (INT64)
Column 63: bitwidth63 (INT64)
Column 64: bitwidth64 (INT64)
Column 65: int_value (INT32)
--- Row Group: 0 ---
--- Total Bytes: 65467 ---
--- Total Compressed Bytes: 0 ---
--- Rows: 200 ---
Column 0
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6374628540732951412, Min: 6374628540732951412
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 95, Compressed Size: 95
Column 1
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -104
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 114, Compressed Size: 114
Column 2
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -82
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 144, Compressed Size: 144
Column 3
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -96
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 172, Compressed Size: 172
Column 4
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -132
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 200, Compressed Size: 200
Column 5
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24, Min: -290
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 228, Compressed Size: 228
Column 6
Values: 200, Null Values: 0, Distinct Values: 0
Max: 259, Min: -93
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 256, Compressed Size: 256
Column 7
Values: 200, Null Values: 0, Distinct Values: 0
Max: 476, Min: -64
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 284, Compressed Size: 284
Column 8
Values: 200, Null Values: 0, Distinct Values: 0
Max: 387, Min: -732
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 314, Compressed Size: 314
Column 9
Values: 200, Null Values: 0, Distinct Values: 0
Max: 194, Min: -1572
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 342, Compressed Size: 342
Column 10
Values: 200, Null Values: 0, Distinct Values: 0
Max: 5336, Min: -2353
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 370, Compressed Size: 370
Column 11
Values: 200, Null Values: 0, Distinct Values: 0
Max: 13445, Min: -8028
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 398, Compressed Size: 398
Column 12
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2017, Min: -35523
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 426, Compressed Size: 426
Column 13
Values: 200, Null Values: 0, Distinct Values: 0
Max: 48649, Min: -4096
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 454, Compressed Size: 454
Column 14
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65709, Min: -8244
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 482, Compressed Size: 482
Column 15
Values: 200, Null Values: 0, Distinct Values: 0
Max: 69786, Min: -106702
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 512, Compressed Size: 512
Column 16
Values: 200, Null Values: 0, Distinct Values: 0
Max: 162951, Min: -347012
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 540, Compressed Size: 540
Column 17
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -1054098
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 568, Compressed Size: 568
Column 18
Values: 200, Null Values: 0, Distinct Values: 0
Max: 664380, Min: -372793
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 596, Compressed Size: 596
Column 19
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4001179, Min: -402775
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 624, Compressed Size: 624
Column 20
Values: 200, Null Values: 0, Distinct Values: 0
Max: 788039, Min: -4434785
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 652, Compressed Size: 652
Column 21
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12455554, Min: -1070042
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 680, Compressed Size: 680
Column 22
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2189135, Min: -17987827
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 710, Compressed Size: 710
Column 23
Values: 200, Null Values: 0, Distinct Values: 0
Max: 25967351, Min: -19361900
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 738, Compressed Size: 738
Column 24
Values: 200, Null Values: 0, Distinct Values: 0
Max: 95688064, Min: -17271207
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 766, Compressed Size: 766
Column 25
Values: 200, Null Values: 0, Distinct Values: 0
Max: 169215083, Min: -18759951
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 794, Compressed Size: 794
Column 26
Values: 200, Null Values: 0, Distinct Values: 0
Max: 163626565, Min: -168761837
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 822, Compressed Size: 822
Column 27
Values: 200, Null Values: 0, Distinct Values: 0
Max: 131734874, Min: -736933601
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 850, Compressed Size: 850
Column 28
Values: 200, Null Values: 0, Distinct Values: 0
Max: 913547745, Min: -490714808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 878, Compressed Size: 878
Column 29
Values: 200, Null Values: 0, Distinct Values: 0
Max: 500305035, Min: -5834684238
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 908, Compressed Size: 908
Column 30
Values: 200, Null Values: 0, Distinct Values: 0
Max: 566280334, Min: -7728643109
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 936, Compressed Size: 936
Column 31
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18831788461, Min: -2498101101
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 964, Compressed Size: 964
Column 32
Values: 200, Null Values: 0, Distinct Values: 0
Max: 23720914586, Min: -2147483648
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 992, Compressed Size: 992
Column 33
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24075494509, Min: -4817999329
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1020, Compressed Size: 1020
Column 34
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12118456329, Min: -156025641218
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1048, Compressed Size: 1048
Column 35
Values: 200, Null Values: 0, Distinct Values: 0
Max: 41614351758, Min: -114682966820
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1076, Compressed Size: 1076
Column 36
Values: 200, Null Values: 0, Distinct Values: 0
Max: 82484946621, Min: -244178626927
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1106, Compressed Size: 1106
Column 37
Values: 200, Null Values: 0, Distinct Values: 0
Max: 361459323159, Min: -275190620271
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1134, Compressed Size: 1134
Column 38
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1665294434042, Min: -420452598502
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1162, Compressed Size: 1162
Column 39
Values: 200, Null Values: 0, Distinct Values: 0
Max: 110454290134, Min: -2926211785103
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1190, Compressed Size: 1190
Column 40
Values: 200, Null Values: 0, Distinct Values: 0
Max: 3215717068302, Min: -4988823342986
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1218, Compressed Size: 1218
Column 41
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2166086616318, Min: -6488418568768
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1246, Compressed Size: 1246
Column 42
Values: 200, Null Values: 0, Distinct Values: 0
Max: 10182365256028, Min: -8738522616121
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1274, Compressed Size: 1274
Column 43
Values: 200, Null Values: 0, Distinct Values: 0
Max: 22909885827147, Min: -21214625470327
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1304, Compressed Size: 1304
Column 44
Values: 200, Null Values: 0, Distinct Values: 0
Max: 67902133645749, Min: -9796939892175
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1332, Compressed Size: 1332
Column 45
Values: 200, Null Values: 0, Distinct Values: 0
Max: 199494208930939, Min: -102473613757961
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1360, Compressed Size: 1360
Column 46
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18564971260296, Min: -359696498357610
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1388, Compressed Size: 1388
Column 47
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65624006999260, Min: -933995610201533
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1416, Compressed Size: 1416
Column 48
Values: 200, Null Values: 0, Distinct Values: 0
Max: 983500521840940, Min: -878019827431629
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1444, Compressed Size: 1444
Column 49
Values: 200, Null Values: 0, Distinct Values: 0
Max: 975533803684560, Min: -2091164446177739
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1472, Compressed Size: 1472
Column 50
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1276327559487856, Min: -5741928190724373
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1502, Compressed Size: 1502
Column 51
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -15996275819941210
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1530, Compressed Size: 1530
Column 52
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12697545666077932, Min: -8823113595895130
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1558, Compressed Size: 1558
Column 53
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4785870085681342, Min: -24800000653307089
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1586, Compressed Size: 1586
Column 54
Values: 200, Null Values: 0, Distinct Values: 0
Max: 26202576654140994, Min: -94647392931900711
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1614, Compressed Size: 1614
Column 55
Values: 200, Null Values: 0, Distinct Values: 0
Max: 358302517069012889, Min: -32197353745654772
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1642, Compressed Size: 1642
Column 56
Values: 200, Null Values: 0, Distinct Values: 0
Max: 678791154000627912, Min: -36028797018963968
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1670, Compressed Size: 1670
Column 57
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1444945950888122232, Min: -79246600304853010
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1700, Compressed Size: 1700
Column 58
Values: 200, Null Values: 0, Distinct Values: 0
Max: 140747723990970254, Min: -1492687553985044679
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1728, Compressed Size: 1728
Column 59
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6318360990909070, Min: -3778424577629102559
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1756, Compressed Size: 1756
Column 60
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4574162334421819801, Min: -576460752303423488
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1784, Compressed Size: 1784
Column 61
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8803535686130338880, Min: -1155450847100943978
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1812, Compressed Size: 1812
Column 62
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9026687750017193101, Min: -4454039315625288390
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1840, Compressed Size: 1840
Column 63
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9150047972721273816, Min: -9220123451143279334
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1868, Compressed Size: 1868
Column 64
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8846115173408951296, Min: -9223372036854775808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1898, Compressed Size: 1898
Column 65
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2142811258, Min: -2078683524
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 980, Compressed Size: 980