Skip to content

Commit 9ce00fd

Browse files
authored
Update README.md
1 parent e3d4c68 commit 9ce00fd

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -34,14 +34,14 @@ Integration is lightweight. For example, if you are evaluating an ImageNet model
3434
```python
3535
from sotabencheval.image_classification import ImageNetEvaluator
3636
evaluator = ImageNetEvaluator(
37-
model_name='ResNeXt-101-32x8d',
38-
paper_arxiv_id='1611.05431')
37+
model_name='FixResNeXt-101 32x48d',
38+
paper_arxiv_id='1906.06423')
3939
```
4040

41-
Then for each batch of predictions your model makes on ImageNet, you pass a dictionary of keys as image IDs and values as output predictions to the `evaluator.add` method:
41+
Then for each batch of predictions your model makes on ImageNet, you would pass a dictionary of keys as image IDs and values as a `np.ndarray`s of logits for each class to the `evaluator.add` method:
4242

4343
```python
44-
evaluator.add(dict(zip(image_ids, batch_output)))
44+
evaluator.add(output_dict=dict(zip(image_ids, batch_output)))
4545
```
4646

4747
This logic just needs to be written in a `sotabench.py` file (which contains whatever evaluation logic you need - e.g loading and processing the data), and sotabench will run it on each commit and record the results:

0 commit comments

Comments
 (0)