Skip to content

Disable qa_tests.jl from default test runs #368

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

ChrisRackauckas-Claude
Copy link

Summary

  • Excludes qa_tests.jl (Quality Assurance and JET tests) from the default "All" test group
  • QA tests can still be run explicitly with GROUP=qa
  • Tests are now tagged with :qa tag to enable selective execution

Changes

  • Added :qa tag to both test items in test/misc/qa_tests.jl
  • Modified test/runtests.jl to exclude :qa tagged tests when GROUP=all
  • QA tests can still be run explicitly by setting GROUP=qa

Motivation

This change prevents QA tests from running in the default pre-test configuration while still allowing them to be run when specifically requested.

🤖 Generated with Claude Code

- Added :qa tag to both Quality Assurance and JET Package Test items
- Modified runtests.jl to exclude :qa tagged tests when GROUP=all
- QA tests can still be run explicitly with GROUP=qa

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>
Copy link
Contributor

github-actions bot commented Aug 9, 2025

Benchmark Results

Click to check benchmark results
master 076660c... master / 076660c...
Simple Pendulum/IIP/BoundaryValueDiffEqMIRK.MIRK2() 0.576 ± 0.013 s 0.607 ± 0.014 s 0.948 ± 0.031
Simple Pendulum/IIP/BoundaryValueDiffEqMIRK.MIRK3() 13.9 ± 0.61 ms 13.9 ± 0.47 ms 1 ± 0.055
Simple Pendulum/IIP/BoundaryValueDiffEqMIRK.MIRK4() 3.27 ± 0.22 ms 3.14 ± 0.18 ms 1.04 ± 0.091
Simple Pendulum/IIP/BoundaryValueDiffEqMIRK.MIRK5() 9.78 ± 1.3 ms 9.41 ± 1.3 ms 1.04 ± 0.2
Simple Pendulum/IIP/BoundaryValueDiffEqMIRK.MIRK6() 1.72 ± 0.28 ms 1.63 ± 0.28 ms 1.05 ± 0.25
Simple Pendulum/IIP/MultipleShooting(10, Tsit5; grid_coarsening = false) 1.86 ± 0.65 ms 1.83 ± 0.64 ms 1.02 ± 0.5
Simple Pendulum/IIP/MultipleShooting(10, Tsit5; grid_coarsening = true) 3.17 ± 0.98 ms 3.09 ± 0.95 ms 1.03 ± 0.45
Simple Pendulum/IIP/MultipleShooting(100, Tsit5; grid_coarsening = false) 0.0658 ± 0.0073 s 0.0649 ± 0.0062 s 1.01 ± 0.15
Simple Pendulum/IIP/MultipleShooting(100, Tsit5; grid_coarsening = true) 0.079 ± 0.013 s 0.0774 ± 0.0063 s 1.02 ± 0.19
Simple Pendulum/IIP/Shooting(Tsit5()) 0.25 ± 0.076 ms 0.237 ± 0.075 ms 1.06 ± 0.46
Simple Pendulum/OOP/BoundaryValueDiffEqMIRK.MIRK2() 0.762 ± 0.0031 s 0.73 ± 0.0082 s 1.04 ± 0.012
Simple Pendulum/OOP/BoundaryValueDiffEqMIRK.MIRK3() 16.9 ± 4.8 ms 16.4 ± 4.5 ms 1.03 ± 0.41
Simple Pendulum/OOP/BoundaryValueDiffEqMIRK.MIRK4() 3.61 ± 0.13 ms 3.58 ± 0.22 ms 1.01 ± 0.072
Simple Pendulum/OOP/BoundaryValueDiffEqMIRK.MIRK5() 10.8 ± 0.93 ms 10.7 ± 0.89 ms 1.01 ± 0.12
Simple Pendulum/OOP/BoundaryValueDiffEqMIRK.MIRK6() 1.9 ± 0.17 ms 1.86 ± 0.16 ms 1.02 ± 0.13
Simple Pendulum/OOP/MultipleShooting(10, Tsit5; grid_coarsening = false) 3.58 ± 3.2 ms 3.49 ± 3 ms 1.03 ± 1.3
Simple Pendulum/OOP/MultipleShooting(10, Tsit5; grid_coarsening = true) 6.1 ± 5.4 ms 5.92 ± 4.9 ms 1.03 ± 1.2
Simple Pendulum/OOP/MultipleShooting(100, Tsit5; grid_coarsening = false) 0.118 ± 0.0055 s 0.114 ± 0.0044 s 1.04 ± 0.063
Simple Pendulum/OOP/MultipleShooting(100, Tsit5; grid_coarsening = true) 0.142 ± 0.0069 s 0.139 ± 0.005 s 1.02 ± 0.062
Simple Pendulum/OOP/Shooting(Tsit5()) 0.639 ± 0.048 ms 0.639 ± 0.046 ms 1 ± 0.1
time_to_load 5.38 ± 0.12 s 5.36 ± 0.03 s 1 ± 0.022
### Benchmark Plots A plot of the benchmark results has been uploaded as an artifact to the workflow run for this PR. Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants