Automatic reporting on profiling/benchmarking for PRs and/or releases #178
Description
As part of the release pipeline, it would be nice to automatically report benchmarking/profiling results and how they compare to the last release. This should be available to users somewhere online as well. It would also be nice to have benchmarking reports on PRs—especially for performance-critical parts of the code.
PkgBenchmark.jl and BenchmarkTools.jl provide the necessary APIs to get this set up. A nice (but stale) example project allows you to carry out the benchmarking/automatically comment on PRs using a GitHub Action: BenchmarkCI.jl.