Skip to content

Commit 1f84147

Browse files
Client changes
1 parent 628150e commit 1f84147

File tree

1 file changed

+10
-15
lines changed

1 file changed

+10
-15
lines changed

articles/load-testing/how-to-define-test-criteria.md

Lines changed: 10 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -13,31 +13,26 @@ ms.topic: how-to
1313
# Define fail criteria for load tests by using Azure Load Testing
1414

1515
In this article, you learn how to define fail criteria or auto stop criteria for your load tests with Azure Load Testing. Fail criteria let you define performance and quality expectations for your application under load. Azure Load Testing supports various client and server metrics for defining fail criteria, such as error rate or CPU percentage for an Azure resource. Auto stop criteria enable you to automatically stop your load test when the error rate surpasses a given threshold.
16-
Saloni
16+
1717
## Prerequisites
1818

1919
- An Azure account with an active subscription. If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
2020
- An Azure load testing resource. If you need to create an Azure Load Testing resource, see the quickstart [Create and run a load test](./quickstart-create-and-run-load-test.md).
2121

2222
## Load test fail criteria
2323

24-
Load test fail criteria are conditions for client-side metrics, that your test should meet. You define test criteria at the load test level in Azure Load Testing. A load test can have one or more test criteria. When at least one of the test criteria evaluates to true, the load test gets the *failed* status.
25-
26-
You can define test criteria at two levels. A load test can combine criteria at the different levels.
27-
28-
- At the load test level. For example, to ensure that the total error percentage doesn't exceed a threshold.
29-
- At the JMeter request level (JMeter sampler). For example, you could specify a response time threshold of the *getProducts* request, but disregard the response time of the *sign in* request.
24+
Load test fail criteria are conditions for metrics, that your test should meet. You define test criteria at the load test level in Azure Load Testing. A load test can have one or more test criteria. When at least one of the test criteria evaluates to true, the load test gets the *failed* status.
3025

31-
You can define a maximum of 50 test criteria for a load test. If there are multiple criteria for the same client metric, the criterion with the lowest threshold value is used.
26+
You can define a maximum of 50 test criteria for a load test. If there are multiple criteria for the same metric, the criterion with the lowest threshold value is used.
3227

33-
### Fail criteria structure
28+
### Fail criteria structure for client metrics
3429

3530
The format of fail criteria in Azure Load Testing follows that of a conditional statement for a [supported metric](#supported-client-metrics-for-fail-criteria). For example, ensure that the average number of requests per second is greater than 500.
3631

37-
Fail criteria have the following structure:
32+
For client-side metrics, you can define test criteria at two levels. A load test can combine criteria at the different levels.
3833

39-
- Test criteria at the load test level: `Aggregate_function (client_metric) condition threshold`.
40-
- Test criteria applied to specific JMeter requests: `Request: Aggregate_function (client_metric) condition threshold`.
34+
- At the load test level. For example, to ensure that the total error percentage doesn't exceed a threshold. The structure for the criteria is: `Aggregate_function (client_metric) condition threshold`.
35+
- At the JMeter request level (JMeter sampler). For example, you could specify a response time threshold of the *getProducts* request, but disregard the response time of the *sign in* request. The structure for the criteria is: `Request: Aggregate_function (client_metric) condition threshold`.
4136

4237
The following table describes the different components:
4338

@@ -61,11 +56,11 @@ Azure Load Testing supports the following client metrics:
6156
|`requests_per_sec` | `avg` (average) | Numerical value with up to two decimal places. | `>` (greater than) <BR> `<` (less than) | Number of requests per second. |
6257
|`requests` | `count` | Integer value. | `>` (greater than) <BR> `<` (less than) | Total number of requests. |
6358

64-
## Define load test fail criteria
59+
## Define load test fail criteria for client metrics
6560

6661
# [Azure portal](#tab/portal)
6762

68-
In this section, you configure test criteria for a load test in the Azure portal.
63+
In this section, you configure test criteria for client metric for a load test in the Azure portal.
6964

7065
1. In the [Azure portal](https://portal.azure.com), go to your Azure Load Testing resource.
7166

@@ -95,7 +90,7 @@ In this section, you configure test criteria for a load test in the Azure portal
9590

9691
# [Azure Pipelines / GitHub Actions](#tab/pipelines+github)
9792

98-
In this section, you configure test criteria for a load test, as part of a CI/CD workflow. Learn how to [set up automated performance testing with CI/CD](./quickstart-add-load-test-cicd.md).
93+
In this section, you configure test criteria for a client metric for a load test, as part of a CI/CD workflow. Learn how to [set up automated performance testing with CI/CD](./quickstart-add-load-test-cicd.md).
9994

10095
For CI/CD workflows, you configure the load test settings in a [YAML test configuration file](./reference-test-config-yaml.md). You store the load test configuration file alongside the JMeter test script file in the source control repository.
10196

0 commit comments

Comments
 (0)