Skip to content
This repository was archived by the owner on Feb 7, 2025. It is now read-only.

Commit 6fcaad2

Browse files
JeremyIRpluckyswansaquino0827jherrflexionsomesylvie
committed
clean up load testing ADR and add context
Co-authored-by: pluckyswan <96704946+pluckyswan@users.noreply.github.com> Co-authored-by: saquino0827 <saquino@flexion.us> Co-authored-by: James Herr <jherr@flexion.us> Co-authored-by: Sylvie <sschuresko@flexion.us> Co-authored-by: jcrichlake <jeff.crichlake@agile6.com>
1 parent fdcb850 commit 6fcaad2

File tree

1 file changed

+18
-3
lines changed

1 file changed

+18
-3
lines changed

adr/008-load-testing.md

Lines changed: 18 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
# 8. Load Testing
22

3-
Date: 2022-12-21
3+
Initial date: 2022-12-21
4+
Updated: 2025-01-07
45

56
## Decision
67

@@ -16,11 +17,16 @@ Accepted.
1617
Load Testing will assist in determining the performance of a system under
1718
real-life load conditions, both normal and extreme.
1819

20+
In January 2025, we added the capability to run load tests automatically on a schedule in Azure.
21+
In the deployed load tests, we're hitting mock ReportStream endpoints. This allows us to 1) not
22+
bombard ReportStream with unexpected traffic and 2) identify performance issues that are specific
23+
to the Intermediary.
24+
1925
## Impact
2026

2127
### Positive
2228

23-
- **Scalability:** Locust.io is highly scalable and can simulate millions of users, making it ideal for both small-scale and large-scale load tests.
29+
- **Scalability:** Locust.io is highly scalable and can simulate millions of users, making it ideal for both small-scale and large-scale load tests.
2430

2531

2632
- **Python-Based:** Writing tests in Python allows for flexibility and ease of use, especially for teams already familiar with the language.
@@ -29,6 +35,9 @@ real-life load conditions, both normal and extreme.
2935
- **Cost Efficiency:** Locust.io is open-source, and doesn’t require licensing fees, which can reduce the overall cost of performance testing.
3036

3137

38+
- **Azure:** Running the load tests on a schedule in a more realistic enviornment gives us more consistent data
39+
40+
3241
### Negative
3342

3443
- **Limited Features:** Compared to more feature-rich tools, Locust.io might lack advanced performance monitoring or detailed reporting features.
@@ -48,6 +57,12 @@ real-life load conditions, both normal and extreme.
4857
- **Resource Usage:** Running large-scale tests using Locust.io may require significant system resources, which could impact cost and infrastructure planning.
4958

5059

60+
- **Locust Future in Azure is Uncertain:** We were able to create a Locust test in Azure in November 2024, but as of January 2025, were unable to create another one. We've submitted a bug report, but if we remain unable to create Locust tests in Azure, we won't be able to expand this test setup to other environments
61+
62+
63+
- **Azure Load Testing Cannot be Terraformed:** Since Azure Load Testing resources can't be created/managed in Terraform, they must be created manually. This is more work and more error prone
64+
65+
5166
### Related Issues
5267

53-
- #76
68+
- #76, #1122

0 commit comments

Comments
 (0)