Change eval_limit from choice to free-form string input

The choice dropdown only allowed specific values (1, 50, 100, 200, 500),
making it annoying to debug with custom instance counts (e.g., 10).
Change to a string input so any positive integer can be entered.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Author: simonrosenberg

.agents/skills/run-eval.md

@@ -32,7 +32,7 @@ curl -X POST \
 
 **Key parameters:**
 - `benchmark`: `swebench`, `swebenchmultimodal`, `gaia`, `swtbench`, `commit0`, `multiswebench`
-- `eval_limit`: `1`, `50`, `100`, `200`, `500`
+- `eval_limit`: Any positive integer (e.g., `1`, `10`, `50`, `200`)
 - `model_ids`: See `.github/run-eval/resolve_model_config.py` for available models
 - `benchmarks_branch`: Use feature branch from the benchmarks repo to test benchmark changes before merging
 

.github/workflows/run-eval.yml

@@ -32,16 +32,10 @@ on:
                 default: false
                 type: boolean
             eval_limit:
-                description: Number of instances to run
+                description: Number of instances to run (any positive integer)
                 required: false
                 default: '1'
-                type: choice
-                options:
-                    - '1'
-                    - '100'
-                    - '50'
-                    - '200'
-                    - '500'
+                type: string
             model_ids:
                 description: Comma-separated model IDs to evaluate. Must be keys of MODELS in resolve_model_config.py. Defaults to first model in that
                     dict.