Skip to content

Commit 36641da

Browse files
yew1ebyew1eb
authored
[AURON #1907][CI] Fix YAML syntax error and restore TPCDS CI execution (#1908)
# Which issue does this PR close? Closes #1907 # Rationale for this change # What changes are included in this PR? 1. Fix YAML syntax errors in `tpcds-reusable.yml` blocking TPCDS CI execution. 2. Fix the issue that `auron-it` integration in CI became ineffective after recent PR merges. 3. Normalize unstable TPCDS suite codegen IDs (Scala 2.12/2.13, plan stable) by replacing numbers (e.g., 132) with 'X'. 4. Increase memory allocation to avoid failures caused by high memory consumption of some queries. # Are there any user-facing changes? # How was this patch tested?
1 parent c59a8b4 commit 36641da

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

50 files changed

+215
-161
lines changed

‎.github/workflows/tpcds-reusable.yml‎

Lines changed: 30 additions & 51 deletions
Original file line numberDiff line numberDiff line change
@@ -88,45 +88,6 @@ env:
8888
WGET_OPTS: "--tries=3 --timeout=30 -c"
8989

9090
jobs:
91-
build-validator:
92-
name: Build TPC-DS Validator
93-
runs-on: ubuntu-24.04
94-
steps:
95-
- name: Cache TPC-DS Validator
96-
uses: actions/cache@v5
97-
id: cache-tpcds-validator
98-
with:
99-
key: tpcds-validator_${{ inputs.scalaver }}
100-
path: target/tpcds-validator_${{ inputs.scalaver }}-0.1.0-SNAPSHOT-with-dependencies.jar
101-
102-
- name: Checkout TPC-DS Validator
103-
uses: actions/checkout@v6
104-
if: steps.cache-tpcds-validator.outputs.cache-hit != 'true'
105-
with:
106-
repository: auron-project/tpcds-validator
107-
108-
- name: Setup Java and Maven cache
109-
uses: actions/setup-java@v5
110-
if: steps.cache-tpcds-validator.outputs.cache-hit != 'true'
111-
with:
112-
distribution: 'adopt-hotspot'
113-
java-version: ${{ inputs.javaver }}
114-
cache: 'maven'
115-
116-
- name: Build TPC-DS Validator
117-
if: steps.cache-tpcds-validator.outputs.cache-hit != 'true'
118-
run: ./build/mvn package -DskipTests -Pscala-${{ inputs.scalaver }}
119-
120-
- name: Upload TPC-DS Validator
121-
uses: actions/upload-artifact@v6
122-
with:
123-
name: >
124-
tpcds-validator-${{ inputs.sparkver }}_${{ inputs.scalaver }}-jdk-${{ inputs.javaver
125-
}}${{ inputs.celebornver && format('-{0}', inputs.celebornver) || ''
126-
}}${{ inputs.unifflever && format('-{0}', inputs.unifflever) || '' }}
127-
path: target/tpcds-validator_${{ inputs.scalaver }}-0.1.0-SNAPSHOT-with-dependencies.jar
128-
overwrite: true
129-
13091
build-auron-jar:
13192
name: Build Auron JAR
13293
runs-on: ubuntu-24.04
@@ -159,8 +120,8 @@ jobs:
159120
clippy
160121

161122
- name: Cargo clippy
123+
# First eliminate unwrap; then enable -D warnings to enforce all default lints.
162124
run: |
163-
# First eliminate unwrap; then enable -D warnings to enforce all default lints.
164125
cargo clippy --all-targets --workspace -- -A warnings -A clippy::all -D clippy::unwrap_used
165126
166127
- name: Cargo test
@@ -223,10 +184,18 @@ jobs:
223184
}}${{ inputs.unifflever && format('-{0}', inputs.unifflever) || '' }}
224185
path: target/auron-${{ inputs.sparkver }}_${{ inputs.scalaver }}-pre-*.jar
225186
overwrite: true
187+
- name: Upload auron maven artifacts (Spark ${{ inputs.sparkver }}, Scala ${{ inputs.scalaver }}, JDK ${{ inputs.javaver }})
188+
uses: actions/upload-artifact@v4
189+
with:
190+
name: auron-artifacts-${{ inputs.sparkver }}_${{ inputs.scalaver }}-jdk-${{ inputs.javaver
191+
}}${{ inputs.celebornver && format('-{0}', inputs.celebornver) || ''
192+
}}${{ inputs.unifflever && format('-{0}', inputs.unifflever) || '' }}
193+
path: ~/.m2/repository/org/apache/auron
194+
if-no-files-found: error
226195

227196
run-tpcds-test:
228197
name: Run TPC-DS test ${{ matrix.query }}
229-
needs: [build-validator, build-auron-jar]
198+
needs: [build-auron-jar]
230199
runs-on: ubuntu-24.04
231200
strategy:
232201
fail-fast: false
@@ -286,13 +255,14 @@ jobs:
286255
}}${{ inputs.celebornver && format('-{0}', inputs.celebornver) || ''
287256
}}${{ inputs.unifflever && format('-{0}', inputs.unifflever) || '' }}
288257
289-
- name: Download TPC-DS Validator JAR
258+
- name: Download auron maven artifacts
290259
uses: actions/download-artifact@v7
291260
with:
292261
name: >
293-
tpcds-validator-${{ inputs.sparkver }}_${{ inputs.scalaver }}-jdk-${{ inputs.javaver
294-
}}${{ inputs.celebornver && format('-{0}', inputs.celebornver) || ''
262+
auron-artifacts-${{ inputs.sparkver }}_${{ inputs.scalaver }}-jdk-${{ inputs.javaver
263+
}}${{ inputs.celebornver && format('-{0}', inputs.celebornver) || ''
295264
}}${{ inputs.unifflever && format('-{0}', inputs.unifflever) || '' }}
265+
path: ~/.m2/repository/org/apache/auron
296266

297267
- name: Checkout TPC-DS Data
298268
uses: actions/checkout@v6
@@ -303,7 +273,10 @@ jobs:
303273
- name: Install Auron JAR
304274
run: |
305275
ls -la
306-
cp auron-*${{ inputs.sparkver }}_${{ inputs.scalaver }}*.jar spark-bin-${{ inputs.sparkver }}_${{ inputs.scalaver }}/jars/
276+
jar=$(ls -1 auron-${{ inputs.sparkver }}_${{ inputs.scalaver }}*.jar | head -n1)
277+
[ -n "$jar" ] || { echo "No jar matched: auron-${{ inputs.sparkver }}_${{ inputs.scalaver }}*.jar"; exit 1; }
278+
echo "AURON_SPARK_JAR=$jar" >> "$GITHUB_ENV"
279+
cp "$jar" spark-bin-${{ inputs.sparkver }}_${{ inputs.scalaver }}/jars/
307280
308281
- name: Setup Java and Maven cache
309282
uses: actions/setup-java@v5
@@ -406,16 +379,22 @@ jobs:
406379
cp uniffle-bin-${{ steps.get-dependency-version.outputs.uniffleversion }}/jars/client/spark3/*.jar spark-bin-${{ inputs.sparkver }}_${{ inputs.scalaver }}/jars/
407380
408381
- name: Run TPC-DS Query ${{ matrix.query }}
382+
env:
383+
RUST_LOG: ERROR
384+
RUST_BACKTRACE: 1
385+
SPARK_VERSION: ${{ inputs.sparkver }}
386+
SCALA_VERSION: ${{ inputs.scalaver }}
387+
SPARK_HOME: spark-bin-${{ inputs.sparkver }}_${{ inputs.scalaver }}
409388
run: |
410389
ls -la
411-
export RUST_LOG=ERROR
412-
export RUST_BACKTRACE=1
413-
export SCALA_VERSION=${{ inputs.scalaver }}
414-
export SPARK_HOME=spark-bin-${{ inputs.sparkver }}_${{ inputs.scalaver }}
415-
dev/run-tpcds-test \
390+
ls -la ~/.m2/repository/org/apache/auron
391+
dev/auron-it/run-it.sh \
416392
${{ inputs.extrasparkconf }} \
393+
--type tpcds \
417394
--data-location dev/tpcds_1g \
418-
--query-filter ${{ matrix.query }}
395+
--query-filter ${{ matrix.query }} \
396+
--result-check \
397+
--plan-check
419398
420399
- name: Upload RSS log
421400
if: ${{ failure() && (inputs.celebornver != '' || inputs.unifflever != '') }}

‎dev/auron-it/pom.xml‎

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -81,6 +81,70 @@
8181

8282
<build>
8383
<plugins>
84+
85+
<plugin>
86+
<groupId>org.apache.maven.plugins</groupId>
87+
<artifactId>maven-checkstyle-plugin</artifactId>
88+
<version>${checkstyle-plugin.version}</version>
89+
<configuration>
90+
<failOnViolation>true</failOnViolation>
91+
<includeTestSourceDirectory>true</includeTestSourceDirectory>
92+
<sourceDirectories>
93+
<directory>${project.basedir}/src/main/java</directory>
94+
<directory>${project.basedir}/src/main/scala</directory>
95+
</sourceDirectories>
96+
<testSourceDirectories>
97+
<directory>${project.basedir}/src/test/java</directory>
98+
</testSourceDirectories>
99+
<suppressionsLocation>${maven.multiModuleProjectDirectory}/../../dev/checkstyle-suppressions.xml</suppressionsLocation>
100+
<configLocation>${maven.multiModuleProjectDirectory}/../../dev/checkstyle.xml</configLocation>
101+
<outputFile>${project.basedir}/target/checkstyle-output.xml</outputFile>
102+
<inputEncoding>UTF-8</inputEncoding>
103+
<outputEncoding>UTF-8</outputEncoding>
104+
</configuration>
105+
<dependencies>
106+
<dependency>
107+
<groupId>com.puppycrawl.tools</groupId>
108+
<artifactId>checkstyle</artifactId>
109+
<version>8.29</version>
110+
</dependency>
111+
</dependencies>
112+
<executions>
113+
<execution>
114+
<goals>
115+
<goal>check</goal>
116+
</goals>
117+
<phase>validate</phase>
118+
</execution>
119+
</executions>
120+
</plugin>
121+
122+
<plugin>
123+
<groupId>org.scalastyle</groupId>
124+
<artifactId>scalastyle-maven-plugin</artifactId>
125+
<version>${maven.plugin.scalastyle.version}</version>
126+
<configuration>
127+
<verbose>false</verbose>
128+
<failOnViolation>true</failOnViolation>
129+
<includeTestSourceDirectory>false</includeTestSourceDirectory>
130+
<failOnWarning>false</failOnWarning>
131+
<sourceDirectory>${basedir}/src/main/scala</sourceDirectory>
132+
<testSourceDirectory>${basedir}/src/test/scala</testSourceDirectory>
133+
<configLocation>${maven.multiModuleProjectDirectory}/../../dev/scalastyle-config.xml</configLocation>
134+
<outputFile>${basedir}/target/scalastyle-output.xml</outputFile>
135+
<inputEncoding>${project.build.sourceEncoding}</inputEncoding>
136+
<outputEncoding>${project.reporting.outputEncoding}</outputEncoding>
137+
</configuration>
138+
<executions>
139+
<execution>
140+
<goals>
141+
<goal>check</goal>
142+
</goals>
143+
<phase>validate</phase>
144+
</execution>
145+
</executions>
146+
</plugin>
147+
84148
<!-- spotless -->
85149
<plugin>
86150
<groupId>com.diffplug.spotless</groupId>

‎dev/auron-it/run-it.sh‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -70,8 +70,8 @@ while [[ $# -gt 0 ]]; do
7070
done
7171

7272
exec $SPARK_HOME/bin/spark-submit \
73-
--driver-memory 5g \
74-
--conf spark.driver.memoryOverhead=3072 \
73+
--driver-memory 8g \
74+
--conf spark.driver.memoryOverhead=4g \
7575
--conf spark.auron.memoryFraction=0.8 \
7676
--conf spark.driver.extraJavaOptions=-XX:+UseG1GC \
7777
--conf spark.ui.enabled=false \

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q1.txt‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -440,13 +440,13 @@ Condition : isnotnull((avg(ctr_total_return) * 1.2)#26)
440440
Input [2]: [(avg(ctr_total_return) * 1.2)#26, ctr_store_sk#21]
441441
Arguments: [ctr_store_sk#21 ASC NULLS FIRST], false
442442

443-
(67) SortMergeJoin [codegen id : 1]
443+
(67) SortMergeJoin [codegen id : X]
444444
Left keys [1]: [ctr_store_sk#12]
445445
Right keys [1]: [ctr_store_sk#21]
446446
Join type: Inner
447447
Join condition: (cast(ctr_total_return#13 as decimal(24,7)) > (avg(ctr_total_return) * 1.2)#26)
448448

449-
(68) Project [codegen id : 1]
449+
(68) Project [codegen id : X]
450450
Output [2]: [ctr_customer_sk#11, ctr_store_sk#12]
451451
Input [5]: [ctr_customer_sk#11, ctr_store_sk#12, ctr_total_return#13, (avg(ctr_total_return) * 1.2)#26, ctr_store_sk#21]
452452

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q11.txt‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -888,13 +888,13 @@ Input [2]: [customer_id#71, year_total#72]
888888
Input [2]: [customer_id#71, year_total#72]
889889
Arguments: [customer_id#71 ASC NULLS FIRST], false
890890

891-
(151) SortMergeJoin [codegen id : 1]
891+
(151) SortMergeJoin [codegen id : X]
892892
Left keys [1]: [customer_id#19]
893893
Right keys [1]: [customer_id#71]
894894
Join type: Inner
895895
Join condition: (CASE WHEN (year_total#56 > 0.00) THEN (year_total#72 / year_total#56) END > CASE WHEN (year_total#20 > 0.00) THEN (year_total#37 / year_total#20) END)
896896

897-
(152) Project [codegen id : 1]
897+
(152) Project [codegen id : X]
898898
Output [1]: [customer_preferred_cust_flag#36]
899899
Input [7]: [customer_id#19, year_total#20, customer_preferred_cust_flag#36, year_total#37, year_total#56, customer_id#71, year_total#72]
900900

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q12.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -286,7 +286,7 @@ Arguments: [i_class#8 ASC NULLS FIRST], false
286286
Input [7]: [i_item_desc#6, i_category#9, i_class#8, i_current_price#7, itemrevenue#16, _w0#17, i_item_id#5]
287287
Arguments: [sum(_w0#17) windowspecdefinition(i_class#8, specifiedwindowframe(RowFrame, unboundedpreceding$(), unboundedfollowing$())) AS _we0#18], [i_class#8]
288288

289-
(49) Project [codegen id : 1]
289+
(49) Project [codegen id : X]
290290
Output [7]: [i_item_desc#6, i_category#9, i_class#8, i_current_price#7, itemrevenue#16, ((_w0#17 * 100) / _we0#18) AS revenueratio#19, i_item_id#5]
291291
Input [8]: [i_item_desc#6, i_category#9, i_class#8, i_current_price#7, itemrevenue#16, _w0#17, i_item_id#5, _we0#18]
292292

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q13.txt‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -272,13 +272,13 @@ Input [2]: [ca_address_sk#12, ca_state#13]
272272
Input [2]: [ca_address_sk#12, ca_state#13]
273273
Arguments: [ca_address_sk#12 ASC NULLS FIRST], false
274274

275-
(33) SortMergeJoin [codegen id : 1]
275+
(33) SortMergeJoin [codegen id : X]
276276
Left keys [1]: [ss_addr_sk#4]
277277
Right keys [1]: [ca_address_sk#12]
278278
Join type: Inner
279279
Join condition: ((((ca_state#13 IN (TX,OH) AND (ss_net_profit#10 >= 100.00)) AND (ss_net_profit#10 <= 200.00)) OR ((ca_state#13 IN (OR,NM,KY) AND (ss_net_profit#10 >= 150.00)) AND (ss_net_profit#10 <= 300.00))) OR ((ca_state#13 IN (VA,TX,MS) AND (ss_net_profit#10 >= 50.00)) AND (ss_net_profit#10 <= 250.00)))
280280

281-
(34) Project [codegen id : 1]
281+
(34) Project [codegen id : X]
282282
Output [7]: [ss_sold_date_sk#1, ss_cdemo_sk#2, ss_hdemo_sk#3, ss_quantity#6, ss_sales_price#7, ss_ext_sales_price#8, ss_ext_wholesale_cost#9]
283283
Input [11]: [ss_sold_date_sk#1, ss_cdemo_sk#2, ss_hdemo_sk#3, ss_addr_sk#4, ss_quantity#6, ss_sales_price#7, ss_ext_sales_price#8, ss_ext_wholesale_cost#9, ss_net_profit#10, ca_address_sk#12, ca_state#13]
284284

@@ -405,13 +405,13 @@ Input [3]: [#17#17, #18#18, #19#19]
405405
Input [3]: [#17#17, #18#18, #19#19]
406406
Arguments: [cd_demo_sk#17 ASC NULLS FIRST], false
407407

408-
(65) SortMergeJoin [codegen id : 2]
408+
(65) SortMergeJoin [codegen id : X]
409409
Left keys [1]: [ss_cdemo_sk#2]
410410
Right keys [1]: [cd_demo_sk#17]
411411
Join type: Inner
412412
Join condition: ((((((cd_marital_status#18 = M) AND (cd_education_status#19 = Advanced Degree)) AND (ss_sales_price#7 >= 100.00)) AND (ss_sales_price#7 <= 150.00)) OR ((((cd_marital_status#18 = S) AND (cd_education_status#19 = College)) AND (ss_sales_price#7 >= 50.00)) AND (ss_sales_price#7 <= 100.00))) OR ((((cd_marital_status#18 = W) AND (cd_education_status#19 = 2 yr Degree)) AND (ss_sales_price#7 >= 150.00)) AND (ss_sales_price#7 <= 200.00)))
413413

414-
(66) Project [codegen id : 2]
414+
(66) Project [codegen id : X]
415415
Output [7]: [ss_hdemo_sk#3, ss_quantity#6, ss_sales_price#7, ss_ext_sales_price#8, ss_ext_wholesale_cost#9, cd_marital_status#18, cd_education_status#19]
416416
Input [9]: [ss_cdemo_sk#2, ss_hdemo_sk#3, ss_quantity#6, ss_sales_price#7, ss_ext_sales_price#8, ss_ext_wholesale_cost#9, #17#17, #18#18, #19#19]
417417

@@ -471,17 +471,17 @@ Input [2]: [#20#20, #21#21]
471471
Input [2]: [#20#20, #21#21]
472472
Arguments: [hd_demo_sk#20 ASC NULLS FIRST], false
473473

474-
(81) SortMergeJoin [codegen id : 3]
474+
(81) SortMergeJoin [codegen id : X]
475475
Left keys [1]: [ss_hdemo_sk#3]
476476
Right keys [1]: [hd_demo_sk#20]
477477
Join type: Inner
478478
Join condition: (((((((cd_marital_status#18 = M) AND (cd_education_status#19 = Advanced Degree)) AND (ss_sales_price#7 >= 100.00)) AND (ss_sales_price#7 <= 150.00)) AND (hd_dep_count#21 = 3)) OR (((((cd_marital_status#18 = S) AND (cd_education_status#19 = College)) AND (ss_sales_price#7 >= 50.00)) AND (ss_sales_price#7 <= 100.00)) AND (hd_dep_count#21 = 1))) OR (((((cd_marital_status#18 = W) AND (cd_education_status#19 = 2 yr Degree)) AND (ss_sales_price#7 >= 150.00)) AND (ss_sales_price#7 <= 200.00)) AND (hd_dep_count#21 = 1)))
479479

480-
(82) Project [codegen id : 3]
480+
(82) Project [codegen id : X]
481481
Output [3]: [ss_quantity#6, ss_ext_sales_price#8, ss_ext_wholesale_cost#9]
482482
Input [9]: [ss_hdemo_sk#3, ss_quantity#6, ss_sales_price#7, ss_ext_sales_price#8, ss_ext_wholesale_cost#9, cd_marital_status#18, cd_education_status#19, #20#20, #21#21]
483483

484-
(83) HashAggregate [codegen id : 3]
484+
(83) HashAggregate [codegen id : X]
485485
Input [3]: [ss_quantity#6, ss_ext_sales_price#8, ss_ext_wholesale_cost#9]
486486
Keys: []
487487
Functions [4]: [partial_avg(ss_quantity#6), partial_avg(UnscaledValue(ss_ext_sales_price#8)), partial_avg(UnscaledValue(ss_ext_wholesale_cost#9)), partial_sum(UnscaledValue(ss_ext_wholesale_cost#9))]
@@ -496,7 +496,7 @@ Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=11]
496496
Output [7]: [sum#29, count#30, sum#31, count#32, sum#33, count#34, sum#35]
497497
Arguments: X
498498

499-
(86) HashAggregate [codegen id : 4]
499+
(86) HashAggregate [codegen id : X]
500500
Input [7]: [sum#29, count#30, sum#31, count#32, sum#33, count#34, sum#35]
501501
Keys: []
502502
Functions [4]: [avg(ss_quantity#6), avg(UnscaledValue(ss_ext_sales_price#8)), avg(UnscaledValue(ss_ext_wholesale_cost#9)), sum(UnscaledValue(ss_ext_wholesale_cost#9))]

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q15.txt‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -225,13 +225,13 @@ Input [3]: [#6#6, #7#7, #8#8]
225225
Input [3]: [#6#6, #7#7, #8#8]
226226
Arguments: [ca_address_sk#6 ASC NULLS FIRST], false
227227

228-
(32) SortMergeJoin [codegen id : 1]
228+
(32) SortMergeJoin [codegen id : X]
229229
Left keys [1]: [c_current_addr_sk#5]
230230
Right keys [1]: [ca_address_sk#6]
231231
Join type: Inner
232232
Join condition: ((substr(ca_zip#8, 1, 5) IN (85669,86197,88274,83405,86475,85392,85460,80348,81792) OR ca_state#7 IN (CA,WA,GA)) OR (cs_sales_price#3 > 500.00))
233233

234-
(33) Project [codegen id : 1]
234+
(33) Project [codegen id : X]
235235
Output [3]: [cs_sold_date_sk#1, cs_sales_price#3, ca_zip#8]
236236
Input [6]: [cs_sold_date_sk#1, cs_sales_price#3, c_current_addr_sk#5, #6#6, #7#7, #8#8]
237237

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q16.txt‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -199,13 +199,13 @@ Input [2]: [#8#8, #9#9]
199199
Input [2]: [#8#8, #9#9]
200200
Arguments: [cs_order_number#9 ASC NULLS FIRST], false
201201

202-
(16) SortMergeJoin [codegen id : 1]
202+
(16) SortMergeJoin [codegen id : X]
203203
Left keys [1]: [cs_order_number#5]
204204
Right keys [1]: [cs_order_number#9]
205205
Join type: LeftSemi
206206
Join condition: NOT (cs_warehouse_sk#4 = cs_warehouse_sk#8)
207207

208-
(17) Project [codegen id : 1]
208+
(17) Project [codegen id : X]
209209
Output [6]: [cs_ship_date_sk#1, cs_ship_addr_sk#2, cs_call_center_sk#3, cs_order_number#5, cs_ext_ship_cost#6, cs_net_profit#7]
210210
Input [7]: [#1#1, #2#2, #3#3, #4#4, #5#5, #6#6, #7#7]
211211

‎dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/q19.txt‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -466,17 +466,17 @@ Input [2]: [#19#19, #20#20]
466466
Input [2]: [#19#19, #20#20]
467467
Arguments: [s_store_sk#19 ASC NULLS FIRST], false
468468

469-
(79) SortMergeJoin [codegen id : 1]
469+
(79) SortMergeJoin [codegen id : X]
470470
Left keys [1]: [ss_store_sk#7]
471471
Right keys [1]: [s_store_sk#19]
472472
Join type: Inner
473473
Join condition: NOT (substr(ca_zip#18, 1, 5) = substr(s_zip#20, 1, 5))
474474

475-
(80) Project [codegen id : 1]
475+
(80) Project [codegen id : X]
476476
Output [5]: [ss_ext_sales_price#8, i_brand_id#10, i_brand#11, i_manufact_id#12, i_manufact#13]
477477
Input [9]: [ss_store_sk#7, ss_ext_sales_price#8, i_brand_id#10, i_brand#11, i_manufact_id#12, i_manufact#13, ca_zip#18, #19#19, #20#20]
478478

479-
(81) HashAggregate [codegen id : 1]
479+
(81) HashAggregate [codegen id : X]
480480
Input [5]: [ss_ext_sales_price#8, i_brand_id#10, i_brand#11, i_manufact_id#12, i_manufact#13]
481481
Keys [4]: [i_brand#11, i_brand_id#10, i_manufact_id#12, i_manufact#13]
482482
Functions [1]: [partial_sum(UnscaledValue(ss_ext_sales_price#8))]
@@ -495,7 +495,7 @@ Arguments: X
495495
Input [5]: [i_brand#11, i_brand_id#10, i_manufact_id#12, i_manufact#13, sum#22]
496496
Arguments: coalesced
497497

498-
(85) HashAggregate [codegen id : 2]
498+
(85) HashAggregate [codegen id : X]
499499
Input [5]: [i_brand#11, i_brand_id#10, i_manufact_id#12, i_manufact#13, sum#22]
500500
Keys [4]: [i_brand#11, i_brand_id#10, i_manufact_id#12, i_manufact#13]
501501
Functions [1]: [sum(UnscaledValue(ss_ext_sales_price#8))]

0 commit comments

Comments
 (0)