Skip to content

Commit 65ca88e

Browse files
committed
finalize pipeline, trigger
1 parent 934dcc8 commit 65ca88e

File tree

11 files changed

+28
-111
lines changed

11 files changed

+28
-111
lines changed

.github/workflows/framework-golden-tests.yml

Lines changed: 4 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -22,20 +22,16 @@ jobs:
2222
config: smoke.toml
2323
count: 1
2424
timeout: 10m
25-
- name: TestLoad
26-
config: load.toml
25+
- name: TestPerformanceBaseline
26+
config: performance_baseline.toml
2727
count: 1
2828
timeout: 10m
2929
- name: TestChaos
3030
config: chaos.toml
3131
count: 1
3232
timeout: 10m
33-
- name: TestUpgradeAll
34-
config: upgrade_all.toml
35-
count: 1
36-
timeout: 10m
37-
- name: TestUpgradeSome
38-
config: upgrade_some.toml
33+
- name: TestUpgrade
34+
config: upgrade.toml
3935
count: 1
4036
timeout: 10m
4137
steps:

book/src/SUMMARY.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@
3939
- [Chainlink]()
4040
- [RPC]()
4141
- [Loki]()
42-
- [Testing](framework/testing.md)
42+
- [Testing Maturity Model](framework/testing.md)
4343
- [Smoke]()
4444
- [Performance]()
4545
- [Chaos]()

book/src/framework/testing.md

Lines changed: 8 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,21 @@
1-
# "Golden" Templates
1+
# Testing Maturity Model
22

33
[Here](https://github.com/smartcontractkit/chainlink-testing-framework/actions/runs/11739154666/job/32703095118?pr=1311) are our "golden" templates for end-to-end tests, covering every test type:
44

55
- `Smoke`
6-
- `Performance`
6+
- `PerformanceBaseline`
77
- `Chaos`
88
- `Upgrade`
99

1010
These tests act as a maturity model and are implemented across all our products.
1111

12-
Run them locally:
12+
Refer to this README to understand the rationale behind our testing approach and to explore the stages of maturity in end-to-end testing.
13+
14+
## Developing
15+
Run the tests locally
1316
```
1417
CTF_CONFIGS=smoke.toml go test -v -run TestSmoke
15-
CTF_CONFIGS=load.toml go test -v -run TestLoad
18+
CTF_CONFIGS=performance_baseline.toml go test -v -run TestPerformanceBaseline
1619
CTF_CONFIGS=chaos.toml go test -v -run TestChaos
17-
CTF_CONFIGS=upgrade_some.toml go test -v -run TestUpgradeSome
20+
CTF_CONFIGS=upgrade.toml go test -v -run TestUpgrade
1821
```
19-
20-
Use this [workflow](https://github.com/smartcontractkit/chainlink-testing-framework/actions/runs/11739154666/workflow?pr=1311) as a starting point for developing a new end-to-end integration test.
21-
22-
Set the count to 5-10 during development, and once stable, set the timeout and proceed to merge.
23-
24-
If you need to structure a lot of different tests (not only end-to-end) follow [this](https://github.com/smartcontractkit/.github/tree/main/.github/workflows) guide.
Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,3 @@
1+
export LOKI_TENANT_ID=promtail
2+
export LOKI_URL=http://localhost:3030/loki/api/v1/push
13
export TESTCONTAINERS_RYUK_DISABLED=true
2-
export PRIVATE_KEY="..."
3-
# load test
4-
#export LOKI_TENANT_ID=promtail
5-
#export LOKI_URL=http://localhost:3030/loki/api/v1/push
6-
#export RESTY_DEBUG=true
7-
export CTF_LOG_LEVEL=info
Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,10 @@
1-
# End-to-End Testing Project Maturity Model
1+
# End-to-End Testing Project Maturity Model
2+
3+
## Developing
4+
Run the tests locally
5+
```
6+
CTF_CONFIGS=smoke.toml go test -v -run TestSmoke
7+
CTF_CONFIGS=performance_baseline.toml go test -v -run TestPerformanceBaseline
8+
CTF_CONFIGS=chaos.toml go test -v -run TestChaos
9+
CTF_CONFIGS=upgrade.toml go test -v -run TestUpgrade
10+
```
File renamed without changes.

framework/examples/myproject/load_test.go renamed to framework/examples/myproject/performance_baseline_test.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ type CfgLoad struct {
1919
NodeSet *ns.Input `toml:"nodeset" validate:"required"`
2020
}
2121

22-
func TestLoad(t *testing.T) {
22+
func TestPerformanceBaseline(t *testing.T) {
2323
in, err := framework.Load[CfgLoad](t)
2424
require.NoError(t, err)
2525

File renamed without changes.

framework/examples/myproject/upgrade_all.toml

Lines changed: 0 additions & 23 deletions
This file was deleted.

framework/examples/myproject/upgrade_all_test.go

Lines changed: 0 additions & 58 deletions
This file was deleted.

0 commit comments

Comments
 (0)