You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -34,14 +34,14 @@ Integration is lightweight. For example, if you are evaluating an ImageNet model
34
34
```python
35
35
from sotabencheval.image_classification import ImageNetEvaluator
36
36
evaluator = ImageNetEvaluator(
37
-
model_name='ResNeXt-101-32x8d',
38
-
paper_arxiv_id='1611.05431')
37
+
model_name='FixResNeXt-101 32x48d',
38
+
paper_arxiv_id='1906.06423')
39
39
```
40
40
41
-
Then for each batch of predictions your model makes on ImageNet, you pass a dictionary of keys as image IDs and values as output predictions to the `evaluator.add` method:
41
+
Then for each batch of predictions your model makes on ImageNet, you would pass a dictionary of keys as image IDs and values as a `np.ndarray`s of logits for each class to the `evaluator.add` method:
This logic just needs to be written in a `sotabench.py` file (which contains whatever evaluation logic you need - e.g loading and processing the data), and sotabench will run it on each commit and record the results:
0 commit comments