|
21 | 21 | - Fix changelog generation by @art049 |
22 | 22 |
|
23 | 23 |
|
24 | | -# Changelog |
25 | | - |
26 | | -<sub>The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).</sub> |
27 | | - |
28 | | -## [Unreleased] |
29 | | - |
30 | | -### <!-- 7 -->⚙️ Internals |
31 | | - |
32 | | -- Fix changelog generation by @art049 |
33 | | - |
34 | 24 | ## [4.0.0] - 2025-07-10 |
35 | 25 |
|
36 | 26 | ### <!-- 0 -->🚀 Features |
37 | | - |
38 | 27 | - Update readme by @art049 |
39 | | - |
40 | | -### <!-- 7 -->⚙️ Internals |
41 | | - |
42 | | -- Remove pre-releases from git-cliff changelog by @art049 |
43 | | -- Link to the documentation by @art049 |
44 | | -- Improve reliability of perf trampoline compatibility checks by @art049 |
45 | | - |
46 | | -## [4.0.0-beta1] - 2025-06-10 |
47 | | - |
48 | | -### <!-- 1 -->🐛 Bug Fixes |
49 | | - |
50 | | -- Reenable walltime instrument hooks by @art049 in [#82](https://github.com/CodSpeedHQ/pytest-codspeed/pull/82) |
51 | | - |
52 | | -## [4.0.0-beta] - 2025-06-06 |
53 | | - |
54 | | -### <!-- 0 -->🚀 Features |
55 | | - |
56 | 28 | - Support pytest-benchmark's pedantic API by @art049 in [#81](https://github.com/CodSpeedHQ/pytest-codspeed/pull/81) |
57 | 29 | - Make sure the benchmark fixture can only be called once per bench by @art049 |
58 | 30 | - Support marker attributes to customize the walltime execution by @art049 in [#80](https://github.com/CodSpeedHQ/pytest-codspeed/pull/80) |
59 | 31 | - Use instrument hooks by @not-matthias |
60 | 32 | - Add instrument-hooks native module by @not-matthias |
61 | 33 |
|
62 | 34 | ### <!-- 1 -->🐛 Bug Fixes |
63 | | - |
| 35 | +- Reenable walltime instrument hooks by @art049 in [#82](https://github.com/CodSpeedHQ/pytest-codspeed/pull/82) |
64 | 36 | - Fix native library typing by @art049 |
65 | 37 |
|
66 | 38 | ### <!-- 6 -->🧪 Testing |
67 | | - |
68 | 39 | - Add benches from the documentation's getting started by @art049 in [#71](https://github.com/CodSpeedHQ/pytest-codspeed/pull/71) |
69 | 40 | - Add simple python benches by @art049 |
70 | 41 |
|
71 | 42 | ### <!-- 7 -->⚙️ Internals |
72 | | - |
| 43 | +- Remove pre-releases from git-cliff changelog by @art049 |
| 44 | +- Link to the documentation by @art049 |
| 45 | +- Improve reliability of perf trampoline compatibility checks by @art049 |
73 | 46 | - Bump ruff by @art049 |
74 | 47 | - Update release workflow to include submodules by @art049 in [#79](https://github.com/CodSpeedHQ/pytest-codspeed/pull/79) |
75 | 48 | - Remove valgrind wrapper by @not-matthias |
76 | 49 | - Update apt before installing packages by @art049 |
77 | 50 |
|
| 51 | + |
78 | 52 | ## [3.2.0] - 2025-01-31 |
79 | 53 |
|
80 | 54 | ### <!-- 0 -->🚀 Features |
81 | | - |
82 | 55 | - Increase the min round time to a bigger value (+/- 1ms) by @art049 |
83 | 56 | - Add benchmarks-walltime job to run additional performance benchmarks by @art049 in [#65](https://github.com/CodSpeedHQ/pytest-codspeed/pull/65) |
84 | 57 | - Fix the random seed while measuring with instruments by @art049 in [#48](https://github.com/CodSpeedHQ/pytest-codspeed/pull/48) |
85 | 58 |
|
86 | 59 | ### <!-- 1 -->🐛 Bug Fixes |
87 | | - |
88 | 60 | - Use time per iteration instead of total round time in stats by @art049 |
89 | 61 |
|
90 | 62 | ### <!-- 2 -->🏗️ Refactor |
91 | | - |
92 | 63 | - Replace hardcoded outlier factor for improved readability by @art049 in [#67](https://github.com/CodSpeedHQ/pytest-codspeed/pull/67) |
93 | 64 |
|
94 | 65 | ### <!-- 7 -->⚙️ Internals |
95 | | - |
96 | 66 | - Fix self-dependency by @adriencaccia in [#66](https://github.com/CodSpeedHQ/pytest-codspeed/pull/66) |
97 | 67 | - Fix uv version in CI by @adriencaccia |
98 | 68 |
|
| 69 | + |
99 | 70 | ## [3.1.2] - 2025-01-09 |
100 | 71 |
|
101 | 72 | ### <!-- 1 -->🐛 Bug Fixes |
102 | | - |
103 | 73 | - Update package_data to include header and source files for valgrind wrapper by @art049 in [#64](https://github.com/CodSpeedHQ/pytest-codspeed/pull/64) |
104 | 74 |
|
| 75 | + |
105 | 76 | ## [3.1.1] - 2025-01-07 |
106 | 77 |
|
107 | 78 | ### <!-- 7 -->⚙️ Internals |
108 | | - |
109 | 79 | - Fix tag num with bumpver by @art049 in [#61](https://github.com/CodSpeedHQ/pytest-codspeed/pull/61) |
110 | 80 | - Update uv lock before release by @art049 |
111 | 81 | - Add a py3-none-any fallback wheel by @art049 |
112 | 82 |
|
113 | | -## [3.1.0] - 2024-12-09 |
114 | | - |
115 | | -### <!-- 2 -->🏗️ Refactor |
116 | | - |
117 | | -- Remove the scripted semver generation by @art049 |
118 | | - |
119 | | -### <!-- 7 -->⚙️ Internals |
120 | | - |
121 | | -- Fix typo in cibuildwheel config by @art049 in [#57](https://github.com/CodSpeedHQ/pytest-codspeed/pull/57) |
122 | 83 |
|
123 | | -## [3.1.0-beta] - 2024-12-06 |
| 84 | +## [3.1.0] - 2024-12-09 |
124 | 85 |
|
125 | 86 | ### <!-- 0 -->🚀 Features |
126 | | - |
127 | 87 | - Check buildability and fallback when build doesn't work by @art049 |
128 | 88 | - Compile the callgrind wrapper at build time by @art049 |
129 | 89 |
|
130 | 90 | ### <!-- 1 -->🐛 Bug Fixes |
131 | | - |
132 | 91 | - Allow build on arm64 by @art049 |
133 | 92 |
|
134 | | -### <!-- 7 -->⚙️ Internals |
| 93 | +### <!-- 2 -->🏗️ Refactor |
| 94 | +- Remove the scripted semver generation by @art049 |
135 | 95 |
|
| 96 | +### <!-- 7 -->⚙️ Internals |
| 97 | +- Fix typo in cibuildwheel config by @art049 in [#57](https://github.com/CodSpeedHQ/pytest-codspeed/pull/57) |
136 | 98 | - Build wheels with cibuildwheel by @art049 |
137 | 99 | - Allow forcing integrated tests by @art049 |
138 | 100 | - Fix release script by @art049 |
|
145 | 107 | - Use uv in CI by @art049 |
146 | 108 | - Commit uv lock file by @art049 |
147 | 109 |
|
| 110 | + |
148 | 111 | ## [3.0.0] - 2024-10-29 |
149 | 112 |
|
150 | 113 | ### <!-- 1 -->🐛 Bug Fixes |
151 | | - |
152 | 114 | - Fix compatibility with pytest-benchmark 5.0.0 by @art049 in [#54](https://github.com/CodSpeedHQ/pytest-codspeed/pull/54) |
153 | 115 |
|
154 | 116 | ### <!-- 7 -->⚙️ Internals |
155 | | - |
156 | 117 | - Drop support for python3.8 by @art049 |
157 | 118 | - Expose type information (#53) by @Dreamsorcerer in [#53](https://github.com/CodSpeedHQ/pytest-codspeed/pull/53) |
158 | 119 | - Run the CI with ubuntu 24.04 by @art049 |
159 | 120 | - Improve naming in workflow examples by @art049 |
160 | 121 | - Bump actions/checkout to v4 (#47) by @fargito in [#47](https://github.com/CodSpeedHQ/pytest-codspeed/pull/47) |
161 | 122 |
|
| 123 | + |
162 | 124 | ## [3.0.0b4] - 2024-09-27 |
163 | 125 |
|
164 | 126 | ### <!-- 0 -->🚀 Features |
165 | | - |
166 | 127 | - Send more outlier data by @art049 |
167 | 128 |
|
168 | 129 | ### <!-- 1 -->🐛 Bug Fixes |
169 | | - |
170 | 130 | - Fix display of parametrized tests by @art049 |
171 | 131 | - Reenable gc logic by @art049 |
172 | 132 |
|
173 | 133 | ### <!-- 6 -->🧪 Testing |
174 | | - |
175 | 134 | - Add benches for various syscalls by @art049 |
176 | 135 |
|
| 136 | + |
177 | 137 | ## [3.0.0b3] - 2024-09-26 |
178 | 138 |
|
179 | 139 | ### <!-- 0 -->🚀 Features |
180 | | - |
181 | 140 | - Also save the lower and upper fences in the json data by @art049 in [#46](https://github.com/CodSpeedHQ/pytest-codspeed/pull/46) |
182 | 141 |
|
183 | 142 | ### <!-- 6 -->🧪 Testing |
184 | | - |
185 | 143 | - Refactor the algorithm benches using parametrization and add benches on bit_manipulation by @art049 |
186 | 144 |
|
| 145 | + |
187 | 146 | ## [3.0.0b2] - 2024-09-24 |
188 | 147 |
|
189 | 148 | ### <!-- 0 -->🚀 Features |
190 | | - |
191 | 149 | - Also save the q1 and q3 in the json data by @art049 in [#45](https://github.com/CodSpeedHQ/pytest-codspeed/pull/45) |
192 | 150 | - Add the --codspeed-max-time flag by @art049 |
193 | 151 |
|
| 152 | + |
194 | 153 | ## [3.0.0b1] - 2024-09-20 |
195 | 154 |
|
196 | 155 | ### <!-- 0 -->🚀 Features |
197 | | - |
198 | 156 | - Send the semver version to cospeed instead of the PEP440 one by @art049 in [#44](https://github.com/CodSpeedHQ/pytest-codspeed/pull/44) |
199 | 157 | - Also store the semver version by @art049 |
200 | 158 |
|
201 | 159 | ### <!-- 6 -->🧪 Testing |
202 | | - |
203 | 160 | - Add benches for TheAlgorithms/backtracking by @art049 in [#43](https://github.com/CodSpeedHQ/pytest-codspeed/pull/43) |
204 | 161 |
|
| 162 | + |
205 | 163 | ## [3.0.0b0] - 2024-09-18 |
206 | 164 |
|
207 | 165 | ### <!-- 0 -->🚀 Features |
208 | | - |
209 | 166 | - Improve table style when displaying results by @art049 in [#41](https://github.com/CodSpeedHQ/pytest-codspeed/pull/41) |
210 | 167 | - Add the total bench time to the collected stats by @art049 |
211 | 168 | - Add configuration and split tests between instruments by @art049 |
|
215 | 172 | - Avoid overriding pytest's default protocol (#32) by @kenodegard in [#32](https://github.com/CodSpeedHQ/pytest-codspeed/pull/32) |
216 | 173 |
|
217 | 174 | ### <!-- 1 -->🐛 Bug Fixes |
218 | | - |
219 | 175 | - Use importlib_metadata to keep backward compatibility by @art049 |
220 | 176 | - Properly decide the mode depending on our env variable spec by @art049 |
221 | 177 | - Disable pytest-speed when installed and codspeed is enabled by @art049 |
222 | 178 |
|
223 | 179 | ### <!-- 2 -->🏗️ Refactor |
224 | | - |
225 | 180 | - Differentiate the mode from the underlying instrument by @art049 |
226 | 181 | - Move the instrumentation wrapper directly in the instrument by @art049 |
227 | 182 | - Change Instrumentation to CPUInstrumentation by @art049 |
228 | 183 | - Create an abstraction for each instrument by @art049 |
229 | 184 |
|
230 | 185 | ### <!-- 3 -->📚 Documentation |
231 | | - |
232 | 186 | - Update action version in the CI workflow configuration (#39) by @frgfm in [#39](https://github.com/CodSpeedHQ/pytest-codspeed/pull/39) |
233 | 187 | - Bump action versions in README by @adriencaccia |
234 | 188 |
|
235 | 189 | ### <!-- 6 -->🧪 Testing |
236 | | - |
237 | 190 | - Add benches for TheAlgorithms/audio_filters by @art049 in [#42](https://github.com/CodSpeedHQ/pytest-codspeed/pull/42) |
238 | 191 |
|
239 | 192 | ### <!-- 7 -->⚙️ Internals |
240 | | - |
241 | 193 | - Add a test on the walltime instrument by @art049 |
242 | 194 | - Fix utils test using a fake git repo by @art049 |
243 | 195 | - Update readme by @art049 |
244 | 196 | - Support python 3.13 and drop 3.7 by @art049 in [#40](https://github.com/CodSpeedHQ/pytest-codspeed/pull/40) |
245 | 197 | - Add TCH, FA, and UP to ruff lints (#29) by @kenodegard in [#29](https://github.com/CodSpeedHQ/pytest-codspeed/pull/29) |
246 | 198 |
|
| 199 | + |
247 | 200 | ## [2.2.1] - 2024-03-19 |
248 | 201 |
|
249 | 202 | ### <!-- 0 -->🚀 Features |
250 | | - |
251 | 203 | - Support pytest 8.1.1 by @art049 |
252 | 204 |
|
253 | 205 | ### <!-- 1 -->🐛 Bug Fixes |
254 | | - |
255 | 206 | - Loosen runtime requirements (#21) by @edgarrmondragon in [#21](https://github.com/CodSpeedHQ/pytest-codspeed/pull/21) |
256 | 207 |
|
257 | 208 | ### <!-- 7 -->⚙️ Internals |
258 | | - |
259 | 209 | - Add all-checks job to CI workflow by @art049 in [#28](https://github.com/CodSpeedHQ/pytest-codspeed/pull/28) |
260 | 210 | - Switch from black to ruff format by @art049 |
261 | 211 | - Update action version in README.md by @adriencaccia |
262 | 212 | - Add codspeed badge to the readme by @art049 |
263 | 213 |
|
| 214 | + |
264 | 215 | ## [2.2.0] - 2023-09-01 |
265 | 216 |
|
266 | 217 | ### <!-- 0 -->🚀 Features |
267 | | - |
268 | 218 | - Avoid concurrent wrapper builds by @art049 |
269 | 219 | - Add a test for pytest-xdist compatibility by @art049 |
270 | 220 |
|
271 | 221 | ### <!-- 1 -->🐛 Bug Fixes |
272 | | - |
273 | 222 | - Fix xdist test output assertion by @art049 |
274 | 223 |
|
| 224 | + |
275 | 225 | ## [2.1.0] - 2023-07-27 |
276 | 226 |
|
277 | 227 | ### <!-- 1 -->🐛 Bug Fixes |
278 | | - |
279 | 228 | - Fix relative git path when using working-directory by @art049 in [#15](https://github.com/CodSpeedHQ/pytest-codspeed/pull/15) |
280 | 229 | - Fix typo in release.yml (#14) by @art049 in [#14](https://github.com/CodSpeedHQ/pytest-codspeed/pull/14) |
281 | 230 |
|
| 231 | + |
282 | 232 | ## [2.0.1] - 2023-07-22 |
283 | 233 |
|
284 | 234 | ### <!-- 0 -->🚀 Features |
285 | | - |
286 | 235 | - Release the package from the CI with trusted provider by @art049 |
287 | 236 | - Add a return type to the benchmark fixture by @art049 in [#13](https://github.com/CodSpeedHQ/pytest-codspeed/pull/13) |
288 | 237 | - Add support for returning values (#12) by @patrick91 in [#12](https://github.com/CodSpeedHQ/pytest-codspeed/pull/12) |
289 | 238 |
|
290 | 239 | ### <!-- 1 -->🐛 Bug Fixes |
291 | | - |
292 | 240 | - Fix setuptools installation with python3.12 by @art049 |
293 | 241 |
|
| 242 | + |
294 | 243 | ## [2.0.0] - 2023-07-04 |
295 | 244 |
|
296 | 245 | ### <!-- 0 -->🚀 Features |
297 | | - |
298 | 246 | - Warmup performance map generation by @art049 |
299 | 247 | - Add some details about the callgraph generation status in the header by @art049 |
300 | 248 | - Test that perf maps are generated by @art049 |
|
304 | 252 | - Add introspection benchmarks by @art049 in [#9](https://github.com/CodSpeedHQ/pytest-codspeed/pull/9) |
305 | 253 |
|
306 | 254 | ### <!-- 1 -->🐛 Bug Fixes |
307 | | - |
308 | 255 | - Support benchmark.extra_info parameters on the fixture by @art049 in [#10](https://github.com/CodSpeedHQ/pytest-codspeed/pull/10) |
309 | 256 | - Filter out pytest-benchmark warnings in the tests by @art049 |
310 | 257 |
|
311 | 258 | ### <!-- 2 -->🏗️ Refactor |
312 | | - |
313 | 259 | - Use the pytest_run_protocol hook for better exec control by @art049 |
314 | 260 |
|
315 | 261 | ### <!-- 7 -->⚙️ Internals |
316 | | - |
317 | 262 | - Separate the benchmark workflow by @art049 in [#8](https://github.com/CodSpeedHQ/pytest-codspeed/pull/8) |
318 | 263 | - Bump version to 1.3.0 to trigger the callgraph generation by @art049 |
319 | 264 | - Reuse same test code in the tests by @art049 |
|
324 | 269 | - Replace isort by ruff by @art049 in [#11](https://github.com/CodSpeedHQ/pytest-codspeed/pull/11) |
325 | 270 | - Add discord badge in the readme by @art049 |
326 | 271 |
|
| 272 | + |
327 | 273 | ## [1.2.2] - 2022-12-02 |
328 | 274 |
|
329 | 275 | ### <!-- 0 -->🚀 Features |
330 | | - |
331 | 276 | - Add library metadata in the profile output by @art049 in [#5](https://github.com/CodSpeedHQ/pytest-codspeed/pull/5) |
332 | 277 |
|
| 278 | + |
333 | 279 | ## [1.2.1] - 2022-11-28 |
334 | 280 |
|
335 | 281 | ### <!-- 1 -->🐛 Bug Fixes |
336 | | - |
337 | 282 | - Support kwargs with the benchmark fixture by @art049 in [#4](https://github.com/CodSpeedHQ/pytest-codspeed/pull/4) |
338 | 283 |
|
| 284 | + |
339 | 285 | ## [1.2.0] - 2022-11-22 |
340 | 286 |
|
341 | 287 | ### <!-- 1 -->🐛 Bug Fixes |
342 | | - |
343 | 288 | - Avoid wrapping the callable to maintain existing results by @art049 |
344 | 289 | - Disable automatic garbage collection to increase stability by @art049 in [#2](https://github.com/CodSpeedHQ/pytest-codspeed/pull/2) |
345 | 290 | - Update readme by @art049 |
346 | 291 |
|
347 | 292 | ### <!-- 7 -->⚙️ Internals |
348 | | - |
349 | 293 | - Update readme by @art049 |
350 | 294 |
|
| 295 | + |
351 | 296 | ## [1.1.0] - 2022-11-10 |
352 | 297 |
|
353 | 298 | ### <!-- 0 -->🚀 Features |
354 | | - |
355 | 299 | - Allow running along with pytest-benchmarks by @art049 |
356 | 300 |
|
357 | 301 | ### <!-- 1 -->🐛 Bug Fixes |
358 | | - |
359 | 302 | - Fix the release script by @art049 |
360 | 303 | - Make the release script executable by @art049 |
361 | 304 | - Match the test output in any order by @art049 |
362 | 305 |
|
363 | 306 | ### <!-- 2 -->🏗️ Refactor |
364 | | - |
365 | 307 | - Manage compatibility env in the conftest by @art049 |
366 | 308 |
|
367 | 309 | ### <!-- 7 -->⚙️ Internals |
368 | | - |
369 | 310 | - Add a pytest-benchmark compatibility test by @art049 in [#1](https://github.com/CodSpeedHQ/pytest-codspeed/pull/1) |
370 | 311 | - Add more details on the pytest run by @art049 |
371 | 312 | - Continue running on matrix item error by @art049 |
372 | 313 | - Add a CI configuration with pytest-benchmark installed by @art049 |
373 | 314 |
|
| 315 | + |
374 | 316 | ## [1.0.1] - 2022-11-05 |
375 | 317 |
|
376 | | -[unreleased]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v4.0.0..HEAD |
377 | | -[4.0.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v4.0.0-beta1..v4.0.0 |
378 | | -[4.0.0-beta1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v4.0.0-beta..v4.0.0-beta1 |
379 | | -[4.0.0-beta]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.2.0..v4.0.0-beta |
| 318 | + |
| 319 | +[4.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v4.0.0..v4.1.0 |
| 320 | +[4.0.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.2.0..v4.0.0 |
380 | 321 | [3.2.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.2..v3.2.0 |
381 | 322 | [3.1.2]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.1..v3.1.2 |
382 | 323 | [3.1.1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.0..v3.1.1 |
383 | | -[3.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.0-beta..v3.1.0 |
384 | | -[3.1.0-beta]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0..v3.1.0-beta |
| 324 | +[3.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0..v3.1.0 |
385 | 325 | [3.0.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b4..v3.0.0 |
386 | 326 | [3.0.0b4]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b3..v3.0.0b4 |
387 | 327 | [3.0.0b3]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b2..v3.0.0b3 |
|
0 commit comments