Skip to content

Commit 6f1415d

Browse files
NicolasBissigNicolasBissig
committed
feat(results): results
1 parent 3a89993 commit 6f1415d

File tree

2 files changed

+151
-1
lines changed

2 files changed

+151
-1
lines changed

‎README.md‎

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,4 +51,11 @@ docker compose -f compose.services.yaml stop redis postgres product-service
5151
docker compose -f compose.services.yaml -f compose.session.java.yaml stop session-service
5252
docker compose -f compose.services.yaml -f compose.session.ts.yaml stop session-service
5353
docker compose -f compose.services.yaml down -v redis postgres
54-
```
54+
```
55+
56+
## Remove and purge all
57+
58+
```bash
59+
docker compose -f compose.observability.yaml -f compose.services.yaml -f compose.load.yaml -f compose.session.java.yaml down -v
60+
docker compose -f compose.observability.yaml -f compose.services.yaml -f compose.load.yaml -f compose.session.ts.yaml down -v
61+
```

‎doc/results.md‎

Lines changed: 143 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,143 @@
1+
# Results
2+
3+
## Java & Java
4+
5+
### Instrumented Java & Java
6+
7+
http://188.245.177.12:3000/d/stats/benchmark-statistics?orgId=1&from=1728302852054&to=1728302942022&var-ds=PDF61E9E97939C7ED&var-db=default&var-cores=8
8+
9+
| Service | CPU | Memory |
10+
|-----------------|-------|---------|
11+
| Product Service | 6.27% | 610 MiB |
12+
| Session Service | 3.64% | 371 MiB |
13+
14+
89999 Requests observed
15+
16+
| Category | Request Duration |
17+
|-----------------|------------------|
18+
| Mean | 902.93 µs |
19+
| 50th percentile | 848.99 µs |
20+
| 90th percentile | 1.01 ms |
21+
| 95th percentile | 1.11 ms |
22+
| 99th percentile | 2.29 ms |
23+
| Max | 13.38 ms |
24+
25+
### Baseline Java & Java
26+
27+
http://188.245.177.12:3000/d/stats/benchmark-statistics?orgId=1&from=1728302414000&to=1728302504000&var-ds=PDF61E9E97939C7ED&var-db=default&var-cores=8
28+
29+
| Service | CPU | Memory |
30+
|-----------------|--------|---------|
31+
| Product Service | 4.83% | 492 MiB |
32+
| Session Service | 3.03% | 258 MiB |
33+
34+
90000 Requests observed
35+
36+
| Category | Request Duration |
37+
|-----------------|------------------|
38+
| Mean | 796.92 µs |
39+
| 50th percentile | 766.94 µs |
40+
| 90th percentile | 915.47 µs |
41+
| 95th percentile | 970.11 µs |
42+
| 99th percentile | 1.29 ms |
43+
| Max | 10.04 ms |
44+
45+
### Comparison
46+
47+
| Service | CPU Baseline | CPU Instrumented | Increase | Memory Baseline | Memory Instrumented | Increase | Increase Absolute |
48+
|---------|--------------|------------------|----------|-----------------|---------------------|----------|-------------------|
49+
| Product | 4.83% | 6.27% | +29.8% | 492 MiB | 610 MiB | +24.0% | +118 MiB |
50+
| Session | 3.03% | 3.64% | +20.1% | 258 MiB | 371 MiB | +43.8% | +113 MiB |
51+
52+
| Category | Baseline | Instrumented | Increase |
53+
|-----------------|-----------|--------------|----------|
54+
| Mean | 796.92 µs | 902.93 µs | +13.3% |
55+
| 50th percentile | 766.94 µs | 848.99 µs | +10.7% |
56+
| 90th percentile | 915.47 µs | 1.01 ms | +10.5% |
57+
| 95th percentile | 970.11 µs | 1.11 ms | +14.4% |
58+
| 99th percentile | 1.29 ms | 2.29 ms | +77.5% |
59+
| Max | 10.04 ms | 13.38 ms | +33.3% |
60+
61+
## Java & TypeScript
62+
63+
### Instrumented Java & TypeScript
64+
65+
http://188.245.177.12:3000/d/stats/benchmark-statistics?orgId=1&from=1728291124000&to=1728291224000&var-ds=PDF61E9E97939C7ED&var-db=default&var-cores=8
66+
67+
| Service | CPU | Memory |
68+
|-----------------|-------|---------|
69+
| Product Service | 6.54% | 536 MiB |
70+
| Session Service | 8.56% | 204 MiB |
71+
72+
99.989 Requests observed
73+
74+
| Category | Request Duration |
75+
|-----------------|------------------|
76+
| Mean | 1.92 ms |
77+
| 50th percentile | 1.22 ms |
78+
| 90th percentile | 4.35 ms |
79+
| 95th percentile | 5.99 ms |
80+
| 99th percentile | 8.95 ms |
81+
| Max | 30.18 ms |
82+
83+
### Baseline Java & TypeScript
84+
85+
http://188.245.177.12:3000/d/stats/benchmark-statistics?orgId=1&from=1728302607062&to=1728302697197&var-ds=PDF61E9E97939C7ED&var-db=default&var-cores=8
86+
87+
| Service | CPU | Memory |
88+
|-----------------|-------|----------|
89+
| Product Service | 4.87% | 351 MiB |
90+
| Session Service | 3.93% | 97.0 MiB |
91+
92+
90000 Requests observed
93+
94+
| Category | Request Duration |
95+
|-----------------|------------------|
96+
| Mean | 919.69 µs |
97+
| 50th percentile | 876.75 µs |
98+
| 90th percentile | 1.06 ms |
99+
| 95th percentile | 1.17 ms |
100+
| 99th percentile | 1.94 ms |
101+
| Max | 9.64 ms |
102+
103+
### Comparison
104+
105+
| Service | CPU Baseline | CPU Instrumented | Increase | Memory Baseline | Memory Instrumented | Increase | Increase Absolute |
106+
|---------|--------------|------------------|----------|-----------------|---------------------|----------|-------------------|
107+
| Product | 4.87% | 6.54% | +34.3% | 351 MiB | 536 MiB | +52.7% | +185 MiB |
108+
| Session | 3.93% | 8.56% | +117.8% | 97.0 MiB | 204 MiB | +110.3% | +107 MiB |
109+
110+
| Category | Baseline | Instrumented | Increase |
111+
|-----------------|-----------|--------------|----------|
112+
| Mean | 919.69 µs | 1.92 ms | +108.1% |
113+
| 50th percentile | 876.75 µs | 1.22 ms | +39.0% |
114+
| 90th percentile | 1.06 ms | 4.35 ms | +310.4% |
115+
| 95th percentile | 1.17 ms | 5.99 ms | +411.1% |
116+
| 99th percentile | 1.94 ms | 8.95 ms | +361.3% |
117+
| Max | 9.64 ms | 30.18 ms | +213.3% |
118+
119+
120+
## Comparison between both
121+
122+
### Baselines
123+
124+
| Category | Java & Java | Java & TypeScript | Increase |
125+
|----------|-------------|-------------------|----------|
126+
| Mean | 796.92 µs | 919.69 µs | +15.4% |
127+
| 50th | 766.94 µs | 876.75 µs | +14.3% |
128+
| 90th | 915.47 µs | 1.06 ms | +15.5% |
129+
| 95th | 970.11 µs | 1.17 ms | +20.3% |
130+
| 99th | 1.29 ms | 1.94 ms | +50.4% |
131+
| Max | 10.04 ms | 9.64 ms | -4.0% |
132+
133+
### Instrumented
134+
135+
| Category | Java & Java | Java & TypeScript | Increase |
136+
|----------|-------------|-------------------|----------|
137+
| Mean | 902.93 µs | 1.92 ms | +112.0% |
138+
| 50th | 848.99 µs | 1.22 ms | +43.9% |
139+
| 90th | 1.01 ms | 4.35 ms | +331.7% |
140+
| 95th | 1.11 ms | 5.99 ms | +439.6% |
141+
| 99th | 2.29 ms | 8.95 ms | +290.8% |
142+
| Max | 13.38 ms | 30.18 ms | +125.3% |
143+

0 commit comments

Comments
 (0)