Commit 7703ae5
Support metadata in list_problems tool
Updated list_problems tool to handle both old (string list) and new
(dict list with metadata) formats from LLMBenchSimple.
Changes:
- ListProblemsTool now checks if problems are Dicts or Strings
- For Dict format, merges problem metadata with default fields
- Maintains backward compatibility with string-only problem lists
- Ensures all problems have id, name, description, category fields
This enables LLMBenchSimple modules to provide rich metadata like
enable_anthropic_api, custom descriptions, etc. through list_problems.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <[email protected]>1 parent cf0705c commit 7703ae5
1 file changed
+22
-6
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
39 | 53 | | |
40 | 54 | | |
41 | 55 | | |
42 | | - | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
43 | 59 | | |
44 | 60 | | |
45 | 61 | | |
| |||
0 commit comments