Skip to content

feat(benchmarks): add reproducible slim benchmark suite#155

Merged
muscariello merged 25 commits intomainfrom
feat/slim-perf-sec-tools
Mar 25, 2026
Merged

feat(benchmarks): add reproducible slim benchmark suite#155
muscariello merged 25 commits intomainfrom
feat/slim-perf-sec-tools

Conversation

@muscariello
Copy link
Copy Markdown
Member

@muscariello muscariello commented Mar 21, 2026 •
edited
Loading

Adds a reproducible live SLIM benchmark suite, workload-specific Taskfile triggers, and CI markdown reporting artifacts.

fixes #156

@muscariello
feat: add performance and security tools
a0d1d38 
Add slim-bench for performance benchmarking and security-probe for adversarial testing.\nIncludes initial BDD test scaffolding.\n\nSigned-off-by: Luca Muscariello <muscariello@ieee.org>

Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(bench): enhanced benchmark tool and suite
b87c3a2 
Introduces slim-bench for high-throughput testing with simulated CPU metrics. Includes 16-byte payload support, detailed markdown reporting, and Dockerfile for containerized execution (though local runner defaults to native build for speed).

Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(benchmarks): add reproducible slim benchmark suite
dfdb156 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello muscariello requested a review from a team as a code owner March 21, 2026 13:12
@muscariello
fix(benchmarks): provision slim bindings in ci
0949c9b 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(samples): drop unrelated poetry locks
605864f 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(pr): drop planning docs
e867283 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
fix(benchmarks): install compatible slimctl in ci
096295a 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(benchmarks): stream partial results to stdout
76f14c7 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(benchmarks): add stdout summary markers
cd9f6f5 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
fix(benchmarks): stream ci logs and sample cpu on linux
e6724d5 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): increase smoke repeat count
6bfabeb 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): print markdown reports in ci logs
19de996 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): run capacity checks on prs
269173d 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
docs(benchmarks): clarify capacity throughput labels
fe7ae95 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): lengthen ci capacity duration
aff43cb 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): default capacity sweeps to one client
8a44f68 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): raise capacity payload defaults
8bff5bc 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): default capacity payloads to 16kb
db03f24 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(benchmarks): rename capacity task variants
97858e8 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
docs(benchmarks): align capacity descriptions
8d7ab52 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(benchmarks): add modular slim benchmark suite
42b73d2 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
chore(integrations): remove security probe changes from benchmark pr
3f90f60 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
refactor(benchmarks): remove slim benchmark tools directory
3faacb4 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
refactor(benchmarks): use gonum t confidence intervals
b1d69fe 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello
feat(benchmarks): improve slim benchmark reporting and ci stats
eb30448 
Signed-off-by: Luca Muscariello <muscariello@ieee.org>
@muscariello muscariello requested a review from lgecse March 22, 2026 14:08
@muscariello muscariello self-assigned this Mar 22, 2026
lpuskas
lpuskas approved these changes Mar 23, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

@lpuskas lpuskas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@lpuskas lpuskas linked an issue Mar 24, 2026 that may be closed by this pull request
High level design of the performance testing #153
Closed
@lpuskas lpuskas mentioned this pull request Mar 24, 2026
Closed
@muscariello muscariello merged commit 397f60e into main Mar 25, 2026
8 checks passed
@muscariello muscariello deleted the feat/slim-perf-sec-tools branch March 25, 2026 07:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@lpuskas lpuskas lpuskas approved these changes

@msardara msardara Awaiting requested review from msardara

@micpapal micpapal Awaiting requested review from micpapal

@lgecse lgecse Awaiting requested review from lgecse

Assignees

@muscariello muscariello

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Improve SLIM benchmark reporting, capacity stats, and CI artifacts High level design of the performance testing

2 participants

@muscariello @lpuskas