Commit 2e9a2a5
authored
feat: enable all validators and center SVG chart (#61)
* fix: create PR instead of direct push, test with tjs+schemasafe only
* fix: add ajv to test validators (required for README generation)
* fix: use PAT_TOKEN for PR creation to trigger required checks
* fix: use PAT for git push to trigger PR workflows
* fix: use peter-evans/create-pull-request to trigger PR workflows
* feat: enable all validators and center SVG chart
* fix: remove 'returning early' text from SVG
* fix: use head-to-head comparison in SVG chart
Update update-svg.ts to use the same comparison logic as the PR comment:
only tests where BOTH validators pass are compared (apples-to-apples).
This ensures the SVG chart shows consistent performance ratios with
the PR comment benchmarks.
* fix: use adjusted ops/sec in SVG based on head-to-head ratios
Calculate each validator's "adjusted" ops/sec from the head-to-head
ratio comparison. This ensures apples-to-apples comparison where each
bar represents performance on only the tests that both validators pass.
- tjs baseline is taken from the comparison with most shared tests
- Other validators' ops are calculated as: tjs_baseline_ops / ratio
- Maintains familiar ops/sec format while being truly comparable1 parent a82255f commit 2e9a2a5
File tree
3 files changed
+166
-206
lines changed- .github/workflows
- assets
- benchmarks
3 files changed
+166
-206
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
| 8 | + | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
| 12 | + | |
12 | 13 | | |
13 | 14 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | 15 | | |
36 | 16 | | |
37 | 17 | | |
38 | | - | |
39 | | - | |
40 | 18 | | |
41 | 19 | | |
42 | 20 | | |
| |||
71 | 49 | | |
72 | 50 | | |
73 | 51 | | |
74 | | - | |
| 52 | + | |
75 | 53 | | |
76 | 54 | | |
77 | | - | |
78 | | - | |
| 55 | + | |
79 | 56 | | |
80 | 57 | | |
81 | 58 | | |
82 | 59 | | |
83 | 60 | | |
84 | | - | |
85 | 61 | | |
86 | 62 | | |
87 | 63 | | |
| |||
123 | 99 | | |
124 | 100 | | |
125 | 101 | | |
126 | | - | |
127 | | - | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
128 | 108 | | |
129 | 109 | | |
130 | 110 | | |
131 | 111 | | |
132 | | - | |
133 | | - | |
| 112 | + | |
| 113 | + | |
134 | 114 | | |
135 | 115 | | |
136 | 116 | | |
137 | 117 | | |
138 | | - | |
139 | | - | |
140 | | - | |
141 | | - | |
142 | | - | |
143 | | - | |
144 | | - | |
145 | | - | |
146 | | - | |
147 | | - | |
148 | | - | |
149 | | - | |
150 | | - | |
151 | | - | |
152 | | - | |
153 | | - | |
154 | | - | |
155 | | - | |
156 | | - | |
157 | | - | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
Loading
0 commit comments