Skip to content

Commit cfb8cfb

Browse files
Add Benchmarks Projects
1 parent 661d029 commit cfb8cfb

File tree

1 file changed

+61
-0
lines changed

1 file changed

+61
-0
lines changed

small_grants.md

Lines changed: 61 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -118,6 +118,67 @@ PDE discretiations.
118118

119119
**Reviewers**: Chris Rackauckas
120120

121+
## SciMLBenchmarks Compatability Bump for Benchmark Sets (\100 each set)
122+
123+
The [SciMLBenchmarks](https://github.com/SciML/SciMLBenchmarks.jl) are a large set of benchmarks maintained
124+
by the SciML organization. As such, keeping these benchmarks up-to-date can be a time-consuming task.
125+
In many cases, we can end up in a situation where there are many package bumps that need to happen. Sometimes
126+
no code needs to be updated, in other cases the benchmark code does need to be updated. The only way to tell
127+
is to start the update process, bump the project and manifest tomls, and start digging into the results.
128+
129+
These bumps are done in subsets. The currently identified subsets are:
130+
131+
#### ParameterEstimation
132+
133+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/799](https://github.com/SciML/SciMLBenchmarks.jl/pull/799)
134+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1063](https://github.com/SciML/SciMLBenchmarks.jl/pull/1063)
135+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1064](https://github.com/SciML/SciMLBenchmarks.jl/pull/1064)
136+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1065](https://github.com/SciML/SciMLBenchmarks.jl/pull/1065)
137+
138+
#### PINNs
139+
140+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1062](https://github.com/SciML/SciMLBenchmarks.jl/pull/1062)
141+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1061](https://github.com/SciML/SciMLBenchmarks.jl/pull/1061)
142+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1044](https://github.com/SciML/SciMLBenchmarks.jl/pull/1044)
143+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/877](https://github.com/SciML/SciMLBenchmarks.jl/pull/877)
144+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1060](https://github.com/SciML/SciMLBenchmarks.jl/pull/1060)
145+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1059](https://github.com/SciML/SciMLBenchmarks.jl/pull/1059)
146+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1043](https://github.com/SciML/SciMLBenchmarks.jl/pull/1043)
147+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/876](https://github.com/SciML/SciMLBenchmarks.jl/pull/876)
148+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/605](https://github.com/SciML/SciMLBenchmarks.jl/pull/605)
149+
150+
#### ComplicatedPDE
151+
152+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/793](https://github.com/SciML/SciMLBenchmarks.jl/pull/793)
153+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/868](https://github.com/SciML/SciMLBenchmarks.jl/pull/868)
154+
155+
#### DynamicalODE
156+
157+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1025](https://github.com/SciML/SciMLBenchmarks.jl/pull/1025)
158+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/870](https://github.com/SciML/SciMLBenchmarks.jl/pull/870)
159+
160+
#### BayesianInference
161+
162+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/797](https://github.com/SciML/SciMLBenchmarks.jl/pull/797)
163+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/866](https://github.com/SciML/SciMLBenchmarks.jl/pull/866)
164+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1038](https://github.com/SciML/SciMLBenchmarks.jl/pull/1038)
165+
166+
**Information to Get Started**: The
167+
[Contributing Section of the SciMLBenchmarks README](https://github.com/SciML/SciMLBenchmarks.jl?tab=readme-ov-file#contributing)
168+
describes how to contribute to the benchmarks. The benchmark results are
169+
generated using the benchmark server. It is expected that the developer checks that the benchmarks
170+
are appropriately ran and generating correct graphs when updated, and highlight any performance
171+
regressions found through the update process.
172+
173+
**Related Issues**: See the linked pull requests.
174+
175+
**Success Criteria**: The benchmarks should run and give similar results to the pre-updated benchmarks,
176+
and any regressions should be identified with an issue opened in the appropriate repository.
177+
178+
**Recommended Skills**: Willingness to roll up some sleaves and figure out what changed in breaking updates.
179+
180+
**Reviewers**: Chris Rackauckas
181+
121182
## Update BlackBoxOptimizationBenchmarking.jl to the Optimization.jl Interface and Add to SciMLBenchmarks (\$300)
122183

123184
**In Progress**: Claimed by Alonso Cisneros for the time period of September 21st, 2024 - October 20th 2024.

0 commit comments

Comments
 (0)