Skip to content

Conversation

@matt-graham
Copy link
Collaborator

@matt-graham matt-graham commented Nov 29, 2024

A collection of improvements to benchmarking system made during the DiRAC NVIDIA hackathon

  • Due to behaviour noted in NumPy generate_precomputes implementation has cubic in L memory overhead #246 switches to always using JAX implementation for generating precomputes for spherical transforms to avoid cubic in L overhead.
  • Adds benchmark modules for separate precompute versions of transforms.
  • Some improvements to help text of benchmarking scripts
  • Adds option to run benchmarked functions once initially without recording time to remove effect of initial JIT compilation from reported times
  • Fix to issue causing only last parameter set results being recorded in JSON output
  • JSON output now records additional metadata about host system such as installed package versions and information about GPUs and CPUs available, to make these more useful artefacts to store for longer term comparison.

@jasonmcewen jasonmcewen self-requested a review December 11, 2024 13:24
@matt-graham matt-graham merged commit 8f6e4d5 into main Dec 11, 2024
5 checks passed
@matt-graham matt-graham added the enhancement New feature or request label Dec 13, 2024
@matt-graham matt-graham deleted the mmg/benchmark-improvements branch July 9, 2025 12:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants