Skip to content

Commit 11b6faa

Browse files
committed
update maturity model
1 parent 01fe53e commit 11b6faa

File tree

1 file changed

+9
-3
lines changed

1 file changed

+9
-3
lines changed

framework/examples/myproject/README.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,20 @@
1-
# End-to-End Testing Project Maturity Model
1+
# System Testing Maturity Model
22

33
[![Smoke](https://img.shields.io/badge/Level_1-Smoke-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
44
[![Upgrade](https://img.shields.io/badge/Level_2-Upgrade-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
55
[![Performance Baseline](https://img.shields.io/badge/Level_3-Performance_baseline-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
66
[![Resiliency](https://img.shields.io/badge/Level_4-Resiliency-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
77
[![Scalability](https://img.shields.io/badge/Level_5-Scalability-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
88

9+
System-level testing is where you test the entire system (all components working together) to ensure everything behaves as expected in a realistic environment:
10+
- Your own applications/services are deployed in a setup as close to production as possible (Docker, Kubernetes, cloud VMs, etc.).
11+
- Third-party dependencies (like APIs, databases, payment gateways) are replaced with high-fidelity fakes (mocks, stubs, or test versions) to avoid relying on real external systems.
12+
13+
The goal is to catch integration issues, performance problems, and system-wide failures before going to production.
14+
915
## Level 0
1016

11-
The team creates and maintains a high-level test plan outlining the components involved and test cases in any format.
17+
The team creates and maintains a high-level system test plan outlining the components involved and test cases in any format.
1218

1319
If the team decides on minimal or no manual testing and the project is trivial, they can consolidate all test cases into `go test` cases, outline the required implementations and commit templates up front.
1420

@@ -62,7 +68,7 @@ Recommended test cases:
6268
- Stress test (limiting container resources)
6369

6470
## Level 5
65-
The team has complete ownership of their persistent staging environment.
71+
The team has complete ownership of their persistent staging environment or also uses ephemeral environments, usually with `K8s`.
6672

6773
The team can use [components caching](https://smartcontractkit.github.io/chainlink-testing-framework/framework/components/caching.html) to reuse testing logic on staging and substitute staging environment URLs instead of an ephemeral environment.
6874

0 commit comments

Comments
 (0)