Remove walltime benchmarking for now

[saulshanabrook]

Ran out of free minutes and need to wait to set up custom github action runner to re-enable.

[codspeed-hq]

CodSpeed Instrumentation Performance Report

Merging #325 will not alter performance

_{Comparing saulshanabrook-patch-3 (1e15098) with main (db11712)¹}

Summary

✅ 7 untouched benchmarks

Footnotes

1. No successful run was found on main (1e15098) during the generation of this report, so db11712 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩