Skip to content

Commit 5e84b79

Browse files
authored
Add template for label errors/corrected sets
1 parent 1090a68 commit 5e84b79

File tree

1 file changed

+62
-3
lines changed

1 file changed

+62
-3
lines changed

README.md

Lines changed: 62 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,11 @@
22

33
**Release of corrected test sets is delayed due to media coverage. We will release in 2 weeks. Thanks for your patience.**
44

5-
The cleaned and corrected test sets for all ten ML benchmark test sets, along with the indices for all label errors at https://labelerrors.com will be made available here on April 21.
5+
The cleaned and corrected test sets for all ten ML benchmark test sets, along with the indices for all label errors at https://labelerrors.com will be made available here as soon as possible.
66

7-
## Citation for the paper
7+
## Citation
8+
9+
If you use this for your work, please cite this paper:
810

911
```
1012
@misc{northcutt2021labelerrors,
@@ -19,7 +21,64 @@ The cleaned and corrected test sets for all ten ML benchmark test sets, along wi
1921

2022
On arXiv: https://arxiv.org/pdf/2103.14749.pdf
2123

22-
Preliminary versions of this work were accepted to [NeurIPS 2020 (1 workshop)](http://securedata.lol/camera_ready/28.pdf) and ICLR 2021 (2 workshops).
24+
This work was invited as a [contributed talk](https://sites.google.com/connect.hku.hk/robustml-2021/home) at ICLR 2021 RobustML Workshop. Preliminary versions of this work were accepted to [NeurIPS 2020 (1 workshop)](http://securedata.lol/camera_ready/28.pdf) and ICLR 2021 (2 workshops).
25+
26+
## Corrected Test Sets and Label Errors for Each Dataset
27+
28+
<details><summary><b>MNIST</b></summary>
29+
<p>
30+
31+
To be completed soon.
32+
33+
</p>
34+
<details><summary><b>CIFAR-10/CIFAR-100</b></summary>
35+
<p>
36+
37+
To be completed soon.
38+
39+
</p>
40+
<details><summary><b>ImageNet</b></summary>
41+
<p>
42+
43+
To be completed soon.
44+
45+
</p>
46+
<details><summary><b>Caltech-256</b></summary>
47+
<p>
48+
49+
To be completed soon.
50+
51+
</p>
52+
<details><summary><b>QuickDraw</b></summary>
53+
<p>
54+
55+
To be completed soon.
56+
57+
</p>
58+
<details><summary><b>Amazon Reviews</b></summary>
59+
<p>
60+
61+
To be completed soon.
62+
63+
</p>
64+
<details><summary><b>IMDB</b></summary>
65+
<p>
66+
67+
To be completed soon.
68+
69+
</p>
70+
<details><summary><b>20 News</b></summary>
71+
<p>
72+
73+
To be completed soon.
74+
75+
</p>
76+
<details><summary><b>AudioSet</b></summary>
77+
<p>
78+
79+
To be completed soon.
80+
81+
</p>
2382

2483
## Selected News Coverage
2584

0 commit comments

Comments
 (0)