Skip to content

Commit 543c96d

Browse files
skudasovTofel
andauthored
Troubleshooting for obs (#1948)
* update maturity model * update troubleshooting for observability --------- Co-authored-by: Bartek Tofel <[email protected]>
1 parent a9ba314 commit 543c96d

File tree

3 files changed

+15
-3
lines changed

3 files changed

+15
-3
lines changed
140 KB
Loading

book/src/framework/observability/observability_stack.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,3 +28,9 @@ Change compose files under `framework/cmd/observability` and restart the stack (
2828
just reload-cli && ctf obs r
2929
```
3030

31+
## Troubleshooting
32+
33+
### `cadvisor` is not working
34+
Make sure your `Advanced` Docker settings look like this
35+
![img_2.png](img_2.png)
36+

framework/examples/myproject/README.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,20 @@
1-
# End-to-End Testing Project Maturity Model
1+
# System Testing Maturity Model
22

33
[![Smoke](https://img.shields.io/badge/Level_1-Smoke-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
44
[![Upgrade](https://img.shields.io/badge/Level_2-Upgrade-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
55
[![Performance Baseline](https://img.shields.io/badge/Level_3-Performance_baseline-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
66
[![Resiliency](https://img.shields.io/badge/Level_4-Resiliency-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
77
[![Scalability](https://img.shields.io/badge/Level_5-Scalability-blue?branch=maturity-model&job=TestSmoke)](https://github.com/smartcontractkit/chainlink-testing-framework/actions/workflows/framework-golden-tests.yml)
88

9+
System-level testing is where you test the entire system (all components working together) to ensure everything behaves as expected in a realistic environment:
10+
- Your own applications/services are deployed in a setup as close to production as possible (Docker, Kubernetes, cloud VMs, etc.).
11+
- Third-party dependencies (like APIs, databases, payment gateways) are replaced with high-fidelity fakes (mocks, stubs, or test versions) to avoid relying on real external systems.
12+
13+
The goal is to catch integration issues, performance problems, and system-wide failures before going to production.
14+
915
## Level 0
1016

11-
The team creates and maintains a high-level test plan outlining the components involved and test cases in any format.
17+
The team creates and maintains a high-level system test plan outlining the components involved and test cases in any format.
1218

1319
If the team decides on minimal or no manual testing and the project is trivial, they can consolidate all test cases into `go test` cases, outline the required implementations and commit templates up front.
1420

@@ -62,7 +68,7 @@ Recommended test cases:
6268
- Stress test (limiting container resources)
6369

6470
## Level 5
65-
The team has complete ownership of their persistent staging environment.
71+
The team has complete ownership of their persistent staging environment or also uses ephemeral environments, usually with `K8s`.
6672

6773
The team can use [components caching](https://smartcontractkit.github.io/chainlink-testing-framework/framework/components/caching.html) to reuse testing logic on staging and substitute staging environment URLs instead of an ephemeral environment.
6874

0 commit comments

Comments
 (0)