Skip to content

Commit e2ff034

Browse files
committed
scheduler_perf: add thresholds to DRA test cases
They were enabled yesterday and executed seven times, with results that (so far) seem to be fairly stable with just one run that was slower across the board. The links in the YAML can be used to navigate to each test case quickly. The thresholds were chose with a 20% security margin below what seems to be a common result.
1 parent b4f902f commit e2ff034

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

test/integration/scheduler_perf/dra/performance-config.yaml

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,8 @@
9393
featureGates:
9494
SchedulerQueueingHints: false
9595
labels: [performance]
96+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSchedulingWithResourceClaimTemplate%2F5000pods_500nodes%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
97+
threshold: 40 # typically above 51
9698
params:
9799
nodesWithDRA: 500
98100
nodesWithoutDRA: 0
@@ -103,6 +105,8 @@
103105
featureGates:
104106
SchedulerQueueingHints: true
105107
labels: [performance]
108+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSchedulingWithResourceClaimTemplate%2F5000pods_500nodes_QueueingHintsEnabled%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
109+
threshold: 56 # typically above 70
106110
params:
107111
nodesWithDRA: 500
108112
nodesWithoutDRA: 0
@@ -191,6 +195,8 @@
191195
featureGates:
192196
SchedulerQueueingHints: false
193197
labels: [performance]
198+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Fempty_500nodes%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
199+
threshold: 64 # typically above 81
194200
params:
195201
nodesWithDRA: 500
196202
nodesWithoutDRA: 0
@@ -201,6 +207,8 @@
201207
featureGates:
202208
SchedulerQueueingHints: true
203209
labels: [performance]
210+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Fempty_500nodes_QueueingHintsEnabled%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
211+
threshold: 64 # typically above 81
204212
params:
205213
nodesWithDRA: 500
206214
nodesWithoutDRA: 0
@@ -226,6 +234,8 @@
226234
featureGates:
227235
SchedulerQueueingHints: false
228236
labels: [performance]
237+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Fhalf_500nodes%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
238+
threshold: 70 # typically over 78
229239
params:
230240
nodesWithDRA: 500
231241
nodesWithoutDRA: 0
@@ -236,6 +246,8 @@
236246
featureGates:
237247
SchedulerQueueingHints: true
238248
labels: [performance]
249+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Fhalf_500nodes_QueueingHintsEnabled%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
250+
threshold: 60 # typically over 75
239251
params:
240252
nodesWithDRA: 500
241253
nodesWithoutDRA: 0
@@ -261,6 +273,8 @@
261273
featureGates:
262274
SchedulerQueueingHints: false
263275
labels: [performance]
276+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Ffull_500nodes%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
277+
threshold: 60 # typically over 75
264278
params:
265279
nodesWithDRA: 500
266280
nodesWithoutDRA: 0
@@ -271,6 +285,8 @@
271285
featureGates:
272286
SchedulerQueueingHints: true
273287
labels: [performance]
288+
# https://perf-dash.k8s.io/#/?jobname=scheduler-perf-benchmark&metriccategoryname=Scheduler&metricname=BenchmarkPerfScheduling&Metric=SchedulingThroughput&Name=BenchmarkPerfScheduling%2FSteadyStateClusterResourceClaimTemplate%2Ffull_500nodes_QueueingHintsEnabled%2Ftest&event=not%20applicable&extension_point=not%20applicable&plugin=not%20applicable&result=not%20applicable
289+
threshold: 60 # typically over 75
274290
params:
275291
nodesWithDRA: 500
276292
nodesWithoutDRA: 0

0 commit comments

Comments
 (0)