Merge pull request #210 from j9t/refactor/benchmarks-outsourcing

Outsource benchmarks

Author: j9t

.github/dependabot.yml

@@ -7,7 +7,7 @@ updates:
     schedule:
       interval: "monthly"
   - package-ecosystem: "npm"
-    directory: "/benchmarks/"
+    directory: "/backtest/"
     schedule:
       interval: "weekly"
   - package-ecosystem: "github-actions"

.gitignore

@@ -1,6 +1,6 @@
-benchmarks/backtest/
-benchmarks/generated/
-benchmarks/sources/
+backtest/input/
+backtest/errors.log
+backtest/results.*
 demo/build/
 dist/
 node_modules/

CHANGELOG.md

@@ -4,6 +4,13 @@ As of version 2.0.0, all notable changes to HTML Minifier Next (HMN) are documen
 
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and the project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [5.0.4] - 2026-02-06
+
+### Internal
+
+* Outsourced benchmarks (now handled [in separate repository](https://github.com/j9t/minifier-benchmarks)) and refactored backtest
+* Updated benchmarks-related documentation
+
 ## [5.0.3] - 2026-02-04
 
 ### Fixed

README.md

@@ -397,47 +397,7 @@ Available options:
 
 ## Minification comparison
 
-How does HTML Minifier Next compare to other minifiers? (All minification with the most aggressive settings—though without [hyper-optimization](https://meiert.com/blog/the-ways-of-writing-html/#toc-hyper-optimized)—and against a wide range of pages.)
-
-<!-- Auto-generated benchmarks, don’t edit -->
-| Site | Original Size (KB) | [HTML Minifier Next](https://github.com/j9t/html-minifier-next) ([config](https://github.com/j9t/html-minifier-next/blob/main/benchmarks/html-minifier.json))<br>[![npm last update](https://img.shields.io/npm/last-update/html-minifier-next)](https://socket.dev/npm/package/html-minifier-next) | [htmlnano](https://github.com/posthtml/htmlnano)<br>[![npm last update](https://img.shields.io/npm/last-update/htmlnano)](https://socket.dev/npm/package/htmlnano) | [@swc/html](https://github.com/swc-project/swc)<br>[![npm last update](https://img.shields.io/npm/last-update/@swc/html)](https://socket.dev/npm/package/@swc/html) | [minify-html](https://github.com/wilsonzlin/minify-html)<br>[![npm last update](https://img.shields.io/npm/last-update/@minify-html/node)](https://socket.dev/npm/package/@minify-html/node) | [minimize](https://github.com/Swaagie/minimize)<br>[![npm last update](https://img.shields.io/npm/last-update/minimize)](https://socket.dev/npm/package/minimize) | [html­com­pressor.­com](https://htmlcompressor.com/) |
-| --- | --- | --- | --- | --- | --- | --- | --- |
-| [A List Apart](https://alistapart.com/) | 63 | **53** | 55 | 56 | 55 | 58 | 56 |
-| [Apple](https://www.apple.com/) | 236 | **198** | 208 | 212 | 213 | 215 | 215 |
-| [BBC](https://www.bbc.co.uk/) | 648 | **603** | 614 | 609 | 610 | 643 | n/a |
-| [CERN](https://home.cern/) | 150 | **80** | 90 | 90 | 90 | 92 | 95 |
-| [CSS-Tricks](https://css-tricks.com/) | 155 | 127 | **121** | 136 | 137 | 141 | 138 |
-| [ECMAScript](https://tc39.es/ecma262/) | 7261 | **6447** | 6583 | 6465 | 6589 | 6637 | n/a |
-| [EDRi](https://edri.org/) | 80 | **68** | 69 | 69 | 71 | 74 | 72 |
-| [EFF](https://www.eff.org/) | 54 | **45** | 49 | 47 | 48 | 49 | 49 |
-| [European Alternatives](https://european-alternatives.eu/) | 48 | **30** | 32 | 32 | 32 | 32 | 32 |
-| [FAZ](https://www.faz.net/aktuell/) | 1523 | 1393 | **1367** | 1450 | 1461 | 1470 | n/a |
-| [French Tech](https://lafrenchtech.gouv.fr/) | 153 | **122** | 126 | 126 | 126 | 132 | 127 |
-| [Frontend Dogma](https://frontenddogma.com/) | 227 | **219** | 240 | 225 | 227 | 246 | 226 |
-| [Google](https://www.google.com/) | 18 | **16** | 17 | **16** | 17 | 18 | 18 |
-| [Ground News](https://ground.news/) | 1465 | **1328** | 1350 | 1372 | 1377 | 1452 | n/a |
-| [HTML Living Standard](https://html.spec.whatwg.org/multipage/) | 149 | 148 | 153 | **147** | 149 | 155 | 149 |
-| [Igalia](https://www.igalia.com/) | 49 | **34** | 36 | 36 | 36 | 37 | 37 |
-| [Leanpub](https://leanpub.com/) | 241 | **224** | 226 | 226 | 227 | 236 | 238 |
-| [Mastodon](https://mastodon.social/explore) | 38 | 35 | **32** | 35 | 36 | 37 | 37 |
-| [MDN](https://developer.mozilla.org/en-US/) | 109 | **63** | 64 | 65 | 65 | 68 | 68 |
-| [Middle East Eye](https://www.middleeasteye.net/) | 220 | **194** | 200 | 198 | 198 | 199 | 200 |
-| [Mistral AI](https://mistral.ai/) | 343 | **307** | **307** | 310 | 311 | 340 | n/a |
-| [Mozilla](https://www.mozilla.org/) | 47 | **32** | 35 | 35 | 35 | 36 | 36 |
-| [Nielsen Norman Group](https://www.nngroup.com/) | 97 | 73 | **59** | 78 | 80 | 81 | 81 |
-| [SitePoint](https://www.sitepoint.com/) | 494 | 456 | **430** | 468 | 473 | 491 | n/a |
-| [Startup-Verband](https://startupverband.de/) | 43 | **30** | 31 | **30** | 31 | 31 | 31 |
-| [TetraLogical](https://tetralogical.com/) | 59 | 52 | **49** | 51 | 53 | 53 | 53 |
-| [TPGi](https://www.tpgi.com/) | 173 | **157** | 164 | 163 | 164 | 170 | 170 |
-| [United Nations](https://www.un.org/en/) | 151 | **113** | 121 | 125 | 125 | 130 | 123 |
-| [Vivaldi](https://vivaldi.com/) | 93 | **76** | n/a | 79 | 81 | 84 | 82 |
-| [W3C](https://www.w3.org/) | 50 | **36** | 39 | 38 | 38 | 41 | 39 |
-| **Average processing time** |  | 78 ms (30/30) | 169 ms (29/30) | 47 ms (30/30) | **15 ms (30/30)** | 276 ms (30/30) | 1296 ms (24/30) |
-
-(Last updated: Feb 4, 2026)
-<!-- End auto-generated -->
-
-Notes: Minimize does not minify CSS and JS. [HTML Minifier Terser](https://github.com/terser/html-minifier-terser) is currently not included due to issues around whitespace collapsing and removal of code using modern CSS features, issues which appeared to distort the data.
+Please see [**the Minifier Benchmarks project**](https://github.com/j9t/minifier-benchmarks) for details on how HMN compares to other minifiers.
 
 ## Examples
 
@@ -641,27 +601,15 @@ For CLI usage, using a config file is strongly recommended to avoid complex shel
 npm run serve
 ```
 
-### Benchmarks
-
-Benchmarks for minified HTML:
-
-```shell
-cd benchmarks;
-npm i;
-npm run benchmarks
-```
-
-(In case of dependency conflicts, run `npm i` with the `--legacy-peer-deps` flag.)
-
 ### Regression tests
 
 ```shell
-cd benchmarks;
+cd backtest;
 npm i;
 npm run backtest
 ```
 
-The backtest tool tracks minification performance across Git history. Results are saved in `benchmarks/backtest/` as CSV and JSON files.
+The backtest tool tracks minification performance across Git history. Results are saved in the backtest folder as CSV and JSON files.
 
 Parameters: