You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/load-testing/how-to-define-test-criteria.md
+10-15Lines changed: 10 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,31 +13,26 @@ ms.topic: how-to
13
13
# Define fail criteria for load tests by using Azure Load Testing
14
14
15
15
In this article, you learn how to define fail criteria or auto stop criteria for your load tests with Azure Load Testing. Fail criteria let you define performance and quality expectations for your application under load. Azure Load Testing supports various client and server metrics for defining fail criteria, such as error rate or CPU percentage for an Azure resource. Auto stop criteria enable you to automatically stop your load test when the error rate surpasses a given threshold.
16
-
Saloni
16
+
17
17
## Prerequisites
18
18
19
19
- An Azure account with an active subscription. If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
20
20
- An Azure load testing resource. If you need to create an Azure Load Testing resource, see the quickstart [Create and run a load test](./quickstart-create-and-run-load-test.md).
21
21
22
22
## Load test fail criteria
23
23
24
-
Load test fail criteria are conditions for client-side metrics, that your test should meet. You define test criteria at the load test level in Azure Load Testing. A load test can have one or more test criteria. When at least one of the test criteria evaluates to true, the load test gets the *failed* status.
25
-
26
-
You can define test criteria at two levels. A load test can combine criteria at the different levels.
27
-
28
-
- At the load test level. For example, to ensure that the total error percentage doesn't exceed a threshold.
29
-
- At the JMeter request level (JMeter sampler). For example, you could specify a response time threshold of the *getProducts* request, but disregard the response time of the *sign in* request.
24
+
Load test fail criteria are conditions for metrics, that your test should meet. You define test criteria at the load test level in Azure Load Testing. A load test can have one or more test criteria. When at least one of the test criteria evaluates to true, the load test gets the *failed* status.
30
25
31
-
You can define a maximum of 50 test criteria for a load test. If there are multiple criteria for the same client metric, the criterion with the lowest threshold value is used.
26
+
You can define a maximum of 50 test criteria for a load test. If there are multiple criteria for the same metric, the criterion with the lowest threshold value is used.
32
27
33
-
### Fail criteria structure
28
+
### Fail criteria structure for client metrics
34
29
35
30
The format of fail criteria in Azure Load Testing follows that of a conditional statement for a [supported metric](#supported-client-metrics-for-fail-criteria). For example, ensure that the average number of requests per second is greater than 500.
36
31
37
-
Fail criteria have the following structure:
32
+
For client-side metrics, you can define test criteria at two levels. A load test can combine criteria at the different levels.
38
33
39
-
-Test criteria at the load test level: `Aggregate_function (client_metric) condition threshold`.
40
-
-Test criteria applied to specific JMeter requests: `Request: Aggregate_function (client_metric) condition threshold`.
34
+
-At the load test level. For example, to ensure that the total error percentage doesn't exceed a threshold. The structure for the criteria is: `Aggregate_function (client_metric) condition threshold`.
35
+
-At the JMeter request level (JMeter sampler). For example, you could specify a response time threshold of the *getProducts* request, but disregard the response time of the *sign in* request. The structure for the criteria is: `Request: Aggregate_function (client_metric) condition threshold`.
41
36
42
37
The following table describes the different components:
43
38
@@ -61,11 +56,11 @@ Azure Load Testing supports the following client metrics:
61
56
|`requests_per_sec`|`avg` (average) | Numerical value with up to two decimal places. |`>` (greater than) <BR> `<` (less than) | Number of requests per second. |
62
57
|`requests`|`count`| Integer value. |`>` (greater than) <BR> `<` (less than) | Total number of requests. |
63
58
64
-
## Define load test fail criteria
59
+
## Define load test fail criteria for client metrics
65
60
66
61
# [Azure portal](#tab/portal)
67
62
68
-
In this section, you configure test criteria for a load test in the Azure portal.
63
+
In this section, you configure test criteria for client metric for a load test in the Azure portal.
69
64
70
65
1. In the [Azure portal](https://portal.azure.com), go to your Azure Load Testing resource.
71
66
@@ -95,7 +90,7 @@ In this section, you configure test criteria for a load test in the Azure portal
In this section, you configure test criteria for a load test, as part of a CI/CD workflow. Learn how to [set up automated performance testing with CI/CD](./quickstart-add-load-test-cicd.md).
93
+
In this section, you configure test criteria for a client metric for a load test, as part of a CI/CD workflow. Learn how to [set up automated performance testing with CI/CD](./quickstart-add-load-test-cicd.md).
99
94
100
95
For CI/CD workflows, you configure the load test settings in a [YAML test configuration file](./reference-test-config-yaml.md). You store the load test configuration file alongside the JMeter test script file in the source control repository.
0 commit comments