[DO NOT MERGE] Test PR for new rustc-perf

[Kobzol]

I will be using this PR to do test perf. runs using the new rustc-perf benchmarking system.

[Kobzol]

@bors try

[rust-bors]

💔 Test for 83d9fd1 failed: CI. Failed jobs:

• try - dist-x86_64-linux (web logs, extended logs)

[Kobzol]

@bors try

[rust-bors]

☀️ Try build successful (CI)
Build commit: dafa510 (dafa510506324ad5f74d77eb869f98a9aaf7d705, parent: 40ace17fc3891155bad26a50d60a9ab07b83bf8e)

[Kobzol]

@rust-timer build dafa510

[Kobzol]

@rust-timer build dafa510

[rust-timer]

Finished benchmarking commit (dafa510): comparison URL.

Overall result: ❌✅ regressions and improvements - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.2%	[0.1%, 0.4%]	8
Regressions ❌ (secondary)	1.0%	[0.0%, 3.1%]	28
Improvements ✅ (primary)	-0.1%	[-0.2%, -0.1%]	3
Improvements ✅ (secondary)	-0.1%	[-0.1%, -0.1%]	7
All ❌✅ (primary)	0.1%	[-0.2%, 0.4%]	11

Max RSS (memory usage)

Results (primary 5.2%, secondary 8.3%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	5.2%	[0.7%, 17.3%]	229
Regressions ❌ (secondary)	8.3%	[0.8%, 18.3%]	296
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	5.2%	[0.7%, 17.3%]	229

Cycles

Results (primary 4.0%, secondary 4.3%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	4.0%	[2.0%, 8.3%]	106
Regressions ❌ (secondary)	4.5%	[2.1%, 8.5%]	101
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-2.9%	[-3.7%, -2.4%]	3
All ❌✅ (primary)	4.0%	[2.0%, 8.3%]	106

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	17
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	25

Bootstrap: 471.524s -> 491.294s (4.19%)
Artifact size: 388.09 MiB -> 303.63 MiB (-21.76%)

[Kobzol]

@rust-timer build dafa510

[rust-timer]

Finished benchmarking commit (dafa510): comparison URL.

Overall result: ❌✅ regressions and improvements - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.2%	[0.1%, 0.4%]	9
Regressions ❌ (secondary)	0.9%	[0.0%, 3.1%]	29
Improvements ✅ (primary)	-0.1%	[-0.2%, -0.1%]	3
Improvements ✅ (secondary)	-0.1%	[-0.1%, -0.1%]	7
All ❌✅ (primary)	0.1%	[-0.2%, 0.4%]	12

Max RSS (memory usage)

Results (primary 5.1%, secondary 8.3%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	5.1%	[0.7%, 17.3%]	233
Regressions ❌ (secondary)	8.3%	[0.9%, 19.2%]	295
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	5.1%	[0.7%, 17.3%]	233

Cycles

Results (primary 4.0%, secondary 4.2%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	4.0%	[1.8%, 10.1%]	103
Regressions ❌ (secondary)	4.4%	[2.0%, 8.9%]	106
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-2.5%	[-3.6%, -1.9%]	3
All ❌✅ (primary)	4.0%	[1.8%, 10.1%]	103

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	17
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	25

Bootstrap: 471.524s -> 491.339s (4.20%)
Artifact size: 388.09 MiB -> 303.63 MiB (-21.76%)

[Kobzol]

@rust-timer build dafa510

[rust-timer]

Finished benchmarking commit (dafa510): comparison URL.

Overall result: ❌✅ regressions and improvements - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.2%	[0.1%, 0.3%]	8
Regressions ❌ (secondary)	1.0%	[0.0%, 3.1%]	29
Improvements ✅ (primary)	-0.1%	[-0.2%, -0.1%]	3
Improvements ✅ (secondary)	-0.1%	[-0.1%, -0.1%]	7
All ❌✅ (primary)	0.1%	[-0.2%, 0.3%]	11

Max RSS (memory usage)

Results (primary 5.2%, secondary 8.3%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	5.2%	[0.7%, 17.3%]	231
Regressions ❌ (secondary)	8.3%	[0.9%, 19.3%]	296
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	5.2%	[0.7%, 17.3%]	231

Cycles

Results (primary 3.9%, secondary 4.4%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	3.9%	[1.8%, 8.2%]	111
Regressions ❌ (secondary)	4.6%	[1.9%, 8.8%]	97
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-3.0%	[-3.7%, -2.1%]	3
All ❌✅ (primary)	3.9%	[1.8%, 8.2%]	111

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	17
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	25

Bootstrap: 471.524s -> 491.672s (4.27%)
Artifact size: 388.09 MiB -> 303.63 MiB (-21.76%)

[Kobzol]

@bors try @rust-timer queue

[rust-bors]

☀️ Try build successful (CI)
Build commit: 1fd7e25 (1fd7e251688b4c222bc0363ec5659f99dd38002a, parent: fd847d4d5d5d1e96bde2d97635faec8655da6b18)

[rust-timer]

Finished benchmarking commit (1fd7e25): comparison URL.

Overall result: ❌ regressions - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.9%	[0.4%, 1.4%]	9
Regressions ❌ (secondary)	0.5%	[0.0%, 1.1%]	47
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	0.9%	[0.4%, 1.4%]	9

Max RSS (memory usage)

Results (primary -2.2%, secondary 1.2%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	-	-	0
Regressions ❌ (secondary)	1.2%	[1.2%, 1.2%]	1
Improvements ✅ (primary)	-2.2%	[-2.9%, -1.3%]	3
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	-2.2%	[-2.9%, -1.3%]	3

Cycles

Results (primary -2.2%, secondary 1.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	-	-	0
Regressions ❌ (secondary)	2.1%	[1.3%, 2.7%]	3
Improvements ✅ (primary)	-2.2%	[-2.2%, -2.2%]	1
Improvements ✅ (secondary)	-2.4%	[-2.4%, -2.4%]	1
All ❌✅ (primary)	-2.2%	[-2.2%, -2.2%]	1

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	16
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	24

Bootstrap: 473.5s -> 471.52s (-0.42%)
Artifact size: 388.65 MiB -> 388.67 MiB (0.01%)

[Kobzol]

@rust-timer build 1fd7e25

[rust-timer]

Finished benchmarking commit (1fd7e25): comparison URL.

Overall result: ❌ regressions - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.9%	[0.5%, 1.4%]	8
Regressions ❌ (secondary)	0.5%	[0.0%, 1.1%]	47
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	0.9%	[0.5%, 1.4%]	8

Max RSS (memory usage)

Results (primary -1.8%, secondary 1.4%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	-	-	0
Regressions ❌ (secondary)	1.4%	[1.4%, 1.4%]	1
Improvements ✅ (primary)	-1.8%	[-2.3%, -1.3%]	2
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	-1.8%	[-2.3%, -1.3%]	2

Cycles

Results (secondary -1.2%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	-	-	0
Regressions ❌ (secondary)	2.3%	[1.7%, 2.9%]	2
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-8.1%	[-8.1%, -8.1%]	1
All ❌✅ (primary)	-	-	0

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	16
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	24

Bootstrap: 473.5s -> 471.666s (-0.39%)
Artifact size: 388.65 MiB -> 388.67 MiB (0.01%)

[Kobzol]

@rust-timer build 1fd7e25

[Kobzol]

@rust-timer build 1fd7e25

[rust-timer]

Finished benchmarking commit (1fd7e25): comparison URL.

Overall result: ❌ regressions - please read the text below

Benchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @rustbot label: +perf-regression-triaged. If not, please fix the regressions and do another perf run. If its results are neutral or positive, the label will be automatically removed.

@bors rollup=never
@rustbot label: -S-waiting-on-perf +perf-regression

Instruction count

Our most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.

	mean	range	count
Regressions ❌ (primary)	0.9%	[0.4%, 1.5%]	9
Regressions ❌ (secondary)	0.5%	[0.0%, 1.1%]	48
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	0.9%	[0.4%, 1.5%]	9

Max RSS (memory usage)

Results (primary -1.3%, secondary -4.6%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	-	-	0
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-1.3%	[-1.3%, -1.3%]	1
Improvements ✅ (secondary)	-4.6%	[-4.6%, -4.6%]	1
All ❌✅ (primary)	-1.3%	[-1.3%, -1.3%]	1

Cycles

Results (primary 3.1%, secondary 2.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	3.1%	[3.1%, 3.1%]	1
Regressions ❌ (secondary)	2.0%	[1.5%, 2.6%]	2
Improvements ✅ (primary)	-	-	0
Improvements ✅ (secondary)	-	-	0
All ❌✅ (primary)	3.1%	[3.1%, 3.1%]	1

Binary size

Results (primary 0.5%, secondary -0.0%)

A less reliable metric. May be of interest, but not used to determine the overall result above.

	mean	range	count
Regressions ❌ (primary)	1.6%	[0.3%, 2.9%]	8
Regressions ❌ (secondary)	-	-	0
Improvements ✅ (primary)	-0.0%	[-0.0%, -0.0%]	16
Improvements ✅ (secondary)	-0.0%	[-0.1%, -0.0%]	6
All ❌✅ (primary)	0.5%	[-0.0%, 2.9%]	24

Bootstrap: 473.5s -> 471.614s (-0.40%)
Artifact size: 388.65 MiB -> 388.67 MiB (0.01%)

[Kobzol]

Closing, as the new system is now used everywhere.