|
6 | 6 | [](https://github.com/smartcontractkit/chainlink-testing-framework/actions?query=workflow%3Aframework-golden-tests+branch%3Amaturity-mode) |
7 | 7 | [](https://github.com/smartcontractkit/chainlink-testing-framework/actions?query=workflow%3Aframework-golden-tests+branch%3Amaturity-mode) |
8 | 8 |
|
| 9 | +## Level 1 |
| 10 | +The team maintains a system-level smoke test where all components are deployed using docker. |
| 11 | + |
| 12 | +The test is readable, and the README clearly explains its purpose. |
| 13 | + |
| 14 | +The test is reliable and stable when run with a count of 30. If your project includes multiple use cases and functionality suitable for end-to-end testing, you can add additional tests at this level. |
| 15 | + |
| 16 | +## Level 2 |
| 17 | +The team has an "upgrade" test to verify product compatibility with older versions. |
| 18 | + |
| 19 | +While the number of compatible versions is team-determined, identifying incompatibilities at the system level early is a valuable, mature practice. |
| 20 | + |
| 21 | +This test deploys specific platform and plugin versions, performs an end-to-end smoke test, and then upgrades (or migrates) the plugin(s) or platform on the same database to ensure that users remain unaffected by the upgrade. |
| 22 | + |
| 23 | +## Level 3 |
| 24 | +The team has a baseline performance testing suite. |
| 25 | + |
| 26 | +At this level, the focus is not on improving performance but on detecting any performance degradation, supported by a reliable CI pipeline. |
| 27 | + |
| 28 | +This pipeline runs as needed—nightly or before releases—enabling early detection of performance issues across all critical on-chain and off-chain functionality. |
| 29 | + |
| 30 | +## Level 4 |
| 31 | +The team incorporates chaos engineering practices to test the system’s failure modes. |
| 32 | + |
| 33 | +This stage builds on [Level 3](#level-3), as it not only verifies that the system is reliable and can recover from reasonable failures but also ensures an understanding of how these failures impact performance and user experience. |
| 34 | + |
| 35 | +## Level 5 |
| 36 | +The team has complete ownership of their persistent staging environment. |
| 37 | + |
| 38 | +They can perform upgrades, data migrations, and run advanced load tests to validate the scalability of their applications. |
| 39 | + |
9 | 40 | ## Developing |
10 | 41 | Run the tests locally |
11 | 42 | ``` |
|
0 commit comments