Commit db228c2
committed
add cpu support for MMLU bench
simple_evaluate has a device option that seems to default to cuda. People with 128GB or even ~90GB+ of ram should be able to run eval on CPU.
Add auto detection for if torch is available
Signed-off-by: Charlie Doern <cdoern@redhat.com>1 parent 8494a51 commit db228c2
1 file changed
+2
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| 9 | + | |
9 | 10 | | |
10 | 11 | | |
11 | 12 | | |
| |||
58 | 59 | | |
59 | 60 | | |
60 | 61 | | |
| 62 | + | |
61 | 63 | | |
62 | 64 | | |
63 | 65 | | |
| |||
0 commit comments