Skip to content

Commit 6ef1d36

Browse files
Daniel1854Daniel1854
committed
chore: comparison plots
* measure with two digits for short benchmarks * improve labels/markers etc.
1 parent 0744a1d commit 6ef1d36

File tree

89 files changed

+100115
-51575
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

89 files changed

+100115
-51575
lines changed

‎benchmark/counter_satisfiable_1_first-neg.csv‎

Lines changed: 881 additions & 881 deletions
Large diffs are not rendered by default.

‎benchmark/counter_satisfiable_1_first-neg.summary‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
There are:
2-
- 214 matching results
2+
- 212 matching results
33
- 0 non-matching results
4-
- 623 timeout results
4+
- 625 timeout results
55
- 44 'unknown' results

‎benchmark/counter_satisfiable_1_no-sel.csv‎

Lines changed: 881 additions & 881 deletions
Large diffs are not rendered by default.

‎benchmark/counter_satisfiable_1_no-sel.summary‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
There are:
2-
- 81 matching results
2+
- 49 matching results
33
- 0 non-matching results
4-
- 759 timeout results
4+
- 791 timeout results
55
- 41 'unknown' results

‎benchmark/counter_satisfiable_1_zipper-sel.csv‎

Lines changed: 881 additions & 881 deletions
Large diffs are not rendered by default.

‎benchmark/e_auto_casc24_fnt_10.csv‎

Lines changed: 151 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,151 @@
1+
problem,expected_result,result,duration
2+
GRA025+1.p,StatementFalse,Unknown(Timeout),10.1
3+
GRA026+1.p,StatementFalse,Unknown(Timeout),10.1
4+
HWV053+1.p,StatementFalse,Unknown(Timeout),10.1
5+
KRS177+1.p,StatementFalse,Unknown(Timeout),9.7
6+
KRS209+1.p,StatementFalse,Unknown(Timeout),10.1
7+
KRS212+1.p,StatementFalse,Unknown(Timeout),10.1
8+
KRS221+1.p,StatementFalse,Unknown(Timeout),10.1
9+
KRS226+1.p,StatementFalse,Unknown(Timeout),10.1
10+
KRS242+1.p,StatementFalse,Unknown(Timeout),10.1
11+
KRS245+1.p,StatementFalse,Unknown(Timeout),10.1
12+
KRS270+1.p,StatementFalse,Unknown(Timeout),10.1
13+
KRS271+1.p,StatementFalse,Unknown(Timeout),10.1
14+
KRS279+1.p,StatementFalse,Unknown(Timeout),10.0
15+
LCL354+1.p,StatementFalse,Unknown(Timeout),10.1
16+
LCL639+1.015.p,StatementFalse,Unknown(Timeout),10.1
17+
LCL641+1.015.p,StatementFalse,Unknown(Timeout),10.1
18+
LCL647+1.005.p,StatementFalse,StatementFalse,1.2
19+
LCL651+1.020.p,StatementFalse,Unknown(Timeout),10.1
20+
LCL653+1.015.p,StatementFalse,Unknown(Timeout),10.1
21+
LCL655+1.015.p,StatementFalse,Unknown(Timeout),10.1
22+
LCL659+1.015.p,StatementFalse,Unknown(Timeout),10.1
23+
LCL671+1.010.p,StatementFalse,Unknown(Timeout),10.1
24+
LCL675+1.005.p,StatementFalse,StatementFalse,1.6
25+
LCL683+1.020.p,StatementFalse,Unknown(Timeout),10.1
26+
LCL685+1.020.p,StatementFalse,Unknown(Timeout),10.1
27+
MSC013+1.p,StatementFalse,StatementFalse,0.0
28+
MSC014+1.p,StatementFalse,StatementFalse,0.0
29+
MSC016+1.p,StatementFalse,StatementFalse,0.0
30+
NLP048+1.p,StatementFalse,StatementFalse,0.0
31+
NLP138+1.p,StatementFalse,StatementFalse,0.0
32+
NLP163+1.p,StatementFalse,StatementFalse,1.0
33+
NLP168+1.p,StatementFalse,StatementFalse,0.4
34+
NLP191+1.p,StatementFalse,StatementFalse,0.5
35+
NLP194+1.p,StatementFalse,StatementFalse,0.2
36+
NLP195+1.p,StatementFalse,StatementFalse,0.2
37+
NLP197+1.p,StatementFalse,StatementFalse,0.2
38+
NLP221+1.p,StatementFalse,StatementFalse,0.0
39+
NLP222+1.p,StatementFalse,StatementFalse,0.0
40+
NLP237+1.p,StatementFalse,StatementFalse,0.1
41+
SWB004+3.p,StatementFalse,StatementFalse,1.1
42+
SWB005+3.p,StatementFalse,StatementFalse,0.9
43+
SWB007+3.p,StatementFalse,StatementFalse,1.3
44+
SWB011+3.p,StatementFalse,StatementFalse,0.9
45+
SWB016+3.p,StatementFalse,StatementFalse,1.2
46+
SWB017+3.p,StatementFalse,StatementFalse,1.2
47+
SWB028+3.p,StatementFalse,StatementFalse,0.6
48+
SWB032+3.p,StatementFalse,StatementFalse,0.8
49+
SWV012+1.p,StatementFalse,StatementFalse,0.0
50+
SYN330+1.p,StatementFalse,StatementFalse,0.0
51+
SYO593+1.p,StatementFalse,StatementFalse,2.9
52+
COM014+1.p,StatementFalse,Unknown(Timeout),10.2
53+
GEG001+1.p,StatementFalse,Unknown(Timeout),10.1
54+
GRP396+1.p,StatementFalse,Unknown(Timeout),9.5
55+
HAL003+1.p,StatementFalse,Unknown(Timeout),5.5
56+
HAL003+2.p,StatementFalse,Unknown(Timeout),5.5
57+
HAL005+1.p,StatementFalse,Unknown(Timeout),10.1
58+
HWV042+1.p,StatementFalse,Unknown(Timeout),10.0
59+
HWV042+2.p,StatementFalse,Unknown(Timeout),10.0
60+
HWV048+1.p,StatementFalse,Unknown(Timeout),10.0
61+
HWV048+2.p,StatementFalse,Unknown(Timeout),10.0
62+
HWV049+2.p,StatementFalse,Unknown(Timeout),10.1
63+
KLE050+1.p,StatementFalse,Unknown(Timeout),10.1
64+
KLE050+2.p,StatementFalse,Unknown(Timeout),10.2
65+
KLE050+3.p,StatementFalse,Unknown(Timeout),10.1
66+
KLE050+4.p,StatementFalse,Unknown(Timeout),10.1
67+
KLE136+1.p,StatementFalse,Unknown(Timeout),6.6
68+
KLE172+1.p,StatementFalse,Unknown(Timeout),9.4
69+
KRS048+1.p,StatementFalse,StatementFalse,0.0
70+
KRS049+1.p,StatementFalse,StatementFalse,0.0
71+
KRS051+1.p,StatementFalse,Unknown(Timeout),10.1
72+
LAT383+1.p,StatementFalse,Unknown(Timeout),10.0
73+
LAT384+1.p,StatementFalse,Unknown(Timeout),10.0
74+
LAT385+1.p,StatementFalse,Unknown(Timeout),10.1
75+
LAT386+1.p,StatementFalse,Unknown(Timeout),10.1
76+
LCL354+1.p,StatementFalse,Unknown(Timeout),10.0
77+
LCL565+1.p,StatementFalse,Unknown(Timeout),8.6
78+
LCL567+1.p,StatementFalse,Unknown(Timeout),10.1
79+
LCL571+1.p,StatementFalse,Unknown(Timeout),10.1
80+
LCL577+1.p,StatementFalse,Unknown(Timeout),6.2
81+
LCL578+1.p,StatementFalse,Unknown(Timeout),7.3
82+
MGT038+2.p,StatementFalse,Unknown(Timeout),10.1
83+
NLP049+1.p,StatementFalse,Unknown(),0.0
84+
NLP050+1.p,StatementFalse,Unknown(),0.0
85+
NLP051+1.p,StatementFalse,Unknown(),0.0
86+
NLP052+1.p,StatementFalse,Unknown(),0.0
87+
NLP053+1.p,StatementFalse,Unknown(),0.0
88+
NLP069+1.p,StatementFalse,StatementFalse,0.0
89+
NLP070+1.p,StatementFalse,StatementFalse,0.0
90+
NLP071+1.p,StatementFalse,StatementFalse,0.0
91+
NLP072+1.p,StatementFalse,StatementFalse,0.0
92+
NLP073+1.p,StatementFalse,StatementFalse,0.0
93+
NLP074+1.p,StatementFalse,StatementFalse,0.0
94+
NLP075+1.p,StatementFalse,StatementFalse,0.0
95+
NLP077+1.p,StatementFalse,StatementFalse,0.0
96+
NLP078+1.p,StatementFalse,StatementFalse,0.0
97+
NLP085+1.p,StatementFalse,Unknown(),0.0
98+
NLP086+1.p,StatementFalse,Unknown(),0.0
99+
NLP087+1.p,StatementFalse,Unknown(),0.0
100+
NLP088+1.p,StatementFalse,StatementFalse,0.0
101+
NLP089+1.p,StatementFalse,StatementFalse,0.0
102+
NLP090+1.p,StatementFalse,StatementFalse,0.0
103+
NLP091+1.p,StatementFalse,StatementFalse,0.0
104+
NLP092+1.p,StatementFalse,StatementFalse,0.0
105+
NLP093+1.p,StatementFalse,StatementFalse,0.1
106+
NLP180+1.p,StatementFalse,StatementFalse,0.0
107+
NLP181+1.p,StatementFalse,StatementFalse,0.1
108+
NLP182+1.p,StatementFalse,StatementFalse,0.1
109+
NLP184+1.p,StatementFalse,StatementFalse,0.1
110+
NLP186+1.p,StatementFalse,StatementFalse,0.1
111+
NLP187+1.p,StatementFalse,StatementFalse,0.0
112+
NLP210+1.p,StatementFalse,StatementFalse,0.1
113+
NLP211+1.p,StatementFalse,StatementFalse,0.0
114+
NLP213+1.p,StatementFalse,StatementFalse,0.0
115+
NLP214+1.p,StatementFalse,StatementFalse,0.1
116+
NLP215+1.p,StatementFalse,StatementFalse,0.0
117+
NLP216+1.p,StatementFalse,StatementFalse,0.1
118+
NLP217+1.p,StatementFalse,StatementFalse,0.1
119+
NLP218+1.p,StatementFalse,StatementFalse,0.2
120+
NLP250+1.p,StatementFalse,StatementFalse,0.0
121+
NLP253+1.p,StatementFalse,StatementFalse,0.0
122+
NLP254+1.p,StatementFalse,StatementFalse,0.0
123+
NLP255+1.p,StatementFalse,StatementFalse,0.0
124+
NLP256+1.p,StatementFalse,StatementFalse,0.1
125+
NLP259+1.p,StatementFalse,StatementFalse,0.1
126+
NUM437+1.p,StatementFalse,Unknown(Timeout),10.1
127+
NUM439+1.p,StatementFalse,Unknown(Timeout),7.5
128+
NUM440+1.p,StatementFalse,Unknown(Timeout),8.0
129+
NUM441+1.p,StatementFalse,Unknown(Timeout),8.1
130+
NUM445+1.p,StatementFalse,Unknown(Timeout),10.2
131+
NUM445+5.p,StatementFalse,Unknown(Timeout),10.0
132+
NUM446+1.p,StatementFalse,Unknown(Timeout),5.8
133+
NUM447+1.p,StatementFalse,Unknown(Timeout),5.8
134+
NUM448+1.p,StatementFalse,Unknown(Timeout),6.5
135+
NUM449+1.p,StatementFalse,Unknown(Timeout),6.8
136+
PRO007+1.p,StatementFalse,Unknown(Timeout),10.0
137+
PRO007+3.p,StatementFalse,Unknown(Timeout),10.0
138+
PRO007+4.p,StatementFalse,Unknown(Timeout),10.1
139+
PRO013+1.p,StatementFalse,Unknown(Timeout),10.0
140+
PRO013+2.p,StatementFalse,Unknown(Timeout),9.7
141+
PRO013+3.p,StatementFalse,Unknown(Timeout),10.1
142+
PRO013+4.p,StatementFalse,Unknown(Timeout),10.1
143+
RNG110+1.p,StatementFalse,Unknown(Timeout),6.8
144+
SWB036+1.p,StatementFalse,Unknown(Timeout),8.2
145+
SWV238+1.p,StatementFalse,StatementFalse,1.1
146+
SWV482+1.p,StatementFalse,StatementFalse,0.1
147+
SWV482+2.p,StatementFalse,StatementFalse,0.1
148+
SWV483+1.p,StatementFalse,StatementFalse,0.9
149+
SWV483+2.p,StatementFalse,StatementFalse,0.6
150+
SWV484+1.p,StatementFalse,StatementFalse,0.1
151+
SWV485+1.p,StatementFalse,StatementFalse,1.0

‎benchmark/e_auto_casc24_fnt_10.summary‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
There are:
2+
- 71 matching results
3+
- 0 non-matching results
4+
- 71 timeout results
5+
- 8 'unknown' results

0 commit comments

Comments
 (0)