Skip to content

Commit f246813

Browse files
yucaiYucai Yudongjoon-hyun
committed
[SPARK-25508][SQL][TEST] Refactor OrcReadBenchmark to use main method
## What changes were proposed in this pull request? Refactor OrcReadBenchmark to use main method. Generate benchmark result: ``` SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "hive/test:runMain org.apache.spark.sql.hive.orc.OrcReadBenchmark" ``` ## How was this patch tested? manual tests Closes apache#22580 from yucai/SPARK-25508. Lead-authored-by: yucai <[email protected]> Co-authored-by: Yucai Yu <[email protected]> Co-authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 623c2ec commit f246813

File tree

2 files changed

+212
-157
lines changed

2 files changed

+212
-157
lines changed

‎sql/hive/benchmarks/OrcReadBenchmark-results.txt

Lines changed: 173 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,173 @@
1+
================================================================================================
2+
SQL Single Numeric Column Scan
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
SQL Single TINYINT Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------
9+
Native ORC MR 1630 / 1639 9.7 103.6 1.0X
10+
Native ORC Vectorized 253 / 288 62.2 16.1 6.4X
11+
Native ORC Vectorized with copy 227 / 244 69.2 14.5 7.2X
12+
Hive built-in ORC 1980 / 1991 7.9 125.9 0.8X
13+
14+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
15+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
16+
SQL Single SMALLINT Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
17+
------------------------------------------------------------------------------------------------
18+
Native ORC MR 1587 / 1589 9.9 100.9 1.0X
19+
Native ORC Vectorized 227 / 242 69.2 14.5 7.0X
20+
Native ORC Vectorized with copy 228 / 238 69.0 14.5 7.0X
21+
Hive built-in ORC 2323 / 2332 6.8 147.7 0.7X
22+
23+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
24+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
25+
SQL Single INT Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
26+
------------------------------------------------------------------------------------------------
27+
Native ORC MR 1726 / 1771 9.1 109.7 1.0X
28+
Native ORC Vectorized 309 / 333 50.9 19.7 5.6X
29+
Native ORC Vectorized with copy 313 / 321 50.2 19.9 5.5X
30+
Hive built-in ORC 2668 / 2672 5.9 169.6 0.6X
31+
32+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
33+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
34+
SQL Single BIGINT Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
35+
------------------------------------------------------------------------------------------------
36+
Native ORC MR 1722 / 1747 9.1 109.5 1.0X
37+
Native ORC Vectorized 395 / 403 39.8 25.1 4.4X
38+
Native ORC Vectorized with copy 399 / 405 39.4 25.4 4.3X
39+
Hive built-in ORC 2767 / 2777 5.7 175.9 0.6X
40+
41+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
42+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
43+
SQL Single FLOAT Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
44+
------------------------------------------------------------------------------------------------
45+
Native ORC MR 1797 / 1824 8.8 114.2 1.0X
46+
Native ORC Vectorized 434 / 441 36.2 27.6 4.1X
47+
Native ORC Vectorized with copy 437 / 447 36.0 27.8 4.1X
48+
Hive built-in ORC 2701 / 2710 5.8 171.7 0.7X
49+
50+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
51+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
52+
SQL Single DOUBLE Column Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
53+
------------------------------------------------------------------------------------------------
54+
Native ORC MR 1931 / 2028 8.1 122.8 1.0X
55+
Native ORC Vectorized 542 / 557 29.0 34.5 3.6X
56+
Native ORC Vectorized with copy 550 / 564 28.6 35.0 3.5X
57+
Hive built-in ORC 2816 / 3206 5.6 179.1 0.7X
58+
59+
60+
================================================================================================
61+
Int and String Scan
62+
================================================================================================
63+
64+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
65+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
66+
Int and String Scan: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
67+
------------------------------------------------------------------------------------------------
68+
Native ORC MR 4012 / 4068 2.6 382.6 1.0X
69+
Native ORC Vectorized 2337 / 2339 4.5 222.9 1.7X
70+
Native ORC Vectorized with copy 2520 / 2540 4.2 240.3 1.6X
71+
Hive built-in ORC 5503 / 5575 1.9 524.8 0.7X
72+
73+
74+
================================================================================================
75+
Partitioned Table Scan
76+
================================================================================================
77+
78+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
79+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
80+
Partitioned Table: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
81+
------------------------------------------------------------------------------------------------
82+
Data column - Native ORC MR 2020 / 2025 7.8 128.4 1.0X
83+
Data column - Native ORC Vectorized 398 / 409 39.5 25.3 5.1X
84+
Data column - Native ORC Vectorized with copy 406 / 411 38.8 25.8 5.0X
85+
Data column - Hive built-in ORC 2967 / 2969 5.3 188.6 0.7X
86+
Partition column - Native ORC MR 1494 / 1505 10.5 95.0 1.4X
87+
Partition column - Native ORC Vectorized 73 / 82 216.3 4.6 27.8X
88+
Partition column - Native ORC Vectorized with copy 71 / 80 221.4 4.5 28.4X
89+
Partition column - Hive built-in ORC 1932 / 1937 8.1 122.8 1.0X
90+
Both columns - Native ORC MR 2057 / 2071 7.6 130.8 1.0X
91+
Both columns - Native ORC Vectorized 445 / 448 35.4 28.3 4.5X
92+
Both column - Native ORC Vectorized with copy 534 / 539 29.4 34.0 3.8X
93+
Both columns - Hive built-in ORC 2994 / 2994 5.3 190.3 0.7X
94+
95+
96+
================================================================================================
97+
Repeated String Scan
98+
================================================================================================
99+
100+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
101+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
102+
Repeated String: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
103+
------------------------------------------------------------------------------------------------
104+
Native ORC MR 1771 / 1785 5.9 168.9 1.0X
105+
Native ORC Vectorized 372 / 375 28.2 35.5 4.8X
106+
Native ORC Vectorized with copy 543 / 576 19.3 51.8 3.3X
107+
Hive built-in ORC 2671 / 2671 3.9 254.7 0.7X
108+
109+
110+
================================================================================================
111+
String with Nulls Scan
112+
================================================================================================
113+
114+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
115+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
116+
String with Nulls Scan (0.0%): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
117+
------------------------------------------------------------------------------------------------
118+
Native ORC MR 3276 / 3302 3.2 312.5 1.0X
119+
Native ORC Vectorized 1057 / 1080 9.9 100.8 3.1X
120+
Native ORC Vectorized with copy 1420 / 1431 7.4 135.4 2.3X
121+
Hive built-in ORC 5377 / 5407 2.0 512.8 0.6X
122+
123+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
124+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
125+
String with Nulls Scan (0.5%): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
126+
------------------------------------------------------------------------------------------------
127+
Native ORC MR 3147 / 3147 3.3 300.1 1.0X
128+
Native ORC Vectorized 1305 / 1319 8.0 124.4 2.4X
129+
Native ORC Vectorized with copy 1685 / 1686 6.2 160.7 1.9X
130+
Hive built-in ORC 4077 / 4085 2.6 388.8 0.8X
131+
132+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
133+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
134+
String with Nulls Scan (0.95%): Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
135+
------------------------------------------------------------------------------------------------
136+
Native ORC MR 1739 / 1744 6.0 165.8 1.0X
137+
Native ORC Vectorized 500 / 501 21.0 47.7 3.5X
138+
Native ORC Vectorized with copy 618 / 631 17.0 58.9 2.8X
139+
Hive built-in ORC 2411 / 2427 4.3 229.9 0.7X
140+
141+
142+
================================================================================================
143+
Single Column Scan From Wide Columns
144+
================================================================================================
145+
146+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
147+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
148+
Single Column Scan from 100 columns: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
149+
------------------------------------------------------------------------------------------------
150+
Native ORC MR 1348 / 1366 0.8 1285.3 1.0X
151+
Native ORC Vectorized 119 / 134 8.8 113.5 11.3X
152+
Native ORC Vectorized with copy 119 / 148 8.8 113.9 11.3X
153+
Hive built-in ORC 487 / 507 2.2 464.8 2.8X
154+
155+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
156+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
157+
Single Column Scan from 200 columns: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
158+
------------------------------------------------------------------------------------------------
159+
Native ORC MR 2667 / 2837 0.4 2543.6 1.0X
160+
Native ORC Vectorized 203 / 222 5.2 193.4 13.2X
161+
Native ORC Vectorized with copy 217 / 255 4.8 207.0 12.3X
162+
Hive built-in ORC 737 / 741 1.4 702.4 3.6X
163+
164+
OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
165+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
166+
Single Column Scan from 300 columns: Best/Avg Time(ms) Rate(M/s) Per Row(ns) Relative
167+
------------------------------------------------------------------------------------------------
168+
Native ORC MR 3954 / 3956 0.3 3770.4 1.0X
169+
Native ORC Vectorized 348 / 360 3.0 331.7 11.4X
170+
Native ORC Vectorized with copy 349 / 359 3.0 333.2 11.3X
171+
Hive built-in ORC 1057 / 1067 1.0 1008.0 3.7X
172+
173+

0 commit comments

Comments
 (0)