Skip to content

Commit 5c0e118

Browse files
committed
levels
1 parent d61a782 commit 5c0e118

File tree

1 file changed

+31
-0
lines changed

1 file changed

+31
-0
lines changed

framework/examples/myproject/README.md

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,37 @@
66
[![Resiliency](https://img.shields.io/badge/Level_4-Resiliency-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions?query=workflow%3Aframework-golden-tests+branch%3Amaturity-mode)
77
[![Scalability](https://img.shields.io/badge/Level_5-Scalability-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions?query=workflow%3Aframework-golden-tests+branch%3Amaturity-mode)
88

9+
## Level 1
10+
The team maintains a system-level smoke test where all components are deployed using docker.
11+
12+
The test is readable, and the README clearly explains its purpose.
13+
14+
The test is reliable and stable when run with a count of 30. If your project includes multiple use cases and functionality suitable for end-to-end testing, you can add additional tests at this level.
15+
16+
## Level 2
17+
The team has an "upgrade" test to verify product compatibility with older versions.
18+
19+
While the number of compatible versions is team-determined, identifying incompatibilities at the system level early is a valuable, mature practice.
20+
21+
This test deploys specific platform and plugin versions, performs an end-to-end smoke test, and then upgrades (or migrates) the plugin(s) or platform on the same database to ensure that users remain unaffected by the upgrade.
22+
23+
## Level 3
24+
The team has a baseline performance testing suite.
25+
26+
At this level, the focus is not on improving performance but on detecting any performance degradation, supported by a reliable CI pipeline.
27+
28+
This pipeline runs as needed—nightly or before releases—enabling early detection of performance issues across all critical on-chain and off-chain functionality.
29+
30+
## Level 4
31+
The team incorporates chaos engineering practices to test the system’s failure modes.
32+
33+
This stage builds on [Level 3](#level-3), as it not only verifies that the system is reliable and can recover from reasonable failures but also ensures an understanding of how these failures impact performance and user experience.
34+
35+
## Level 5
36+
The team has complete ownership of their persistent staging environment.
37+
38+
They can perform upgrades, data migrations, and run advanced load tests to validate the scalability of their applications.
39+
940
## Developing
1041
Run the tests locally
1142
```

0 commit comments

Comments
 (0)