The AU-ROC of MVTec 3D

[leefty-1024]

Thanks you code. Do you have results of AU-ROC of MVTec 3D？

[caoyunkang]

Hi, thanks for your interest. Unfortunately, the results are not retained... You can easily get the results through a single run. Best.

[leefty-1024]

2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======i_roc: 97.11
2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======p_roc: 99.25
2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======p_pro: 97.89
2024-03-01 14:58:35.145 | INFO | main:main:152 - bagel=======threshold: 0.81

2024-03-01 15:04:17.110 | INFO | main:main:152 - cable_gland=======i_roc: 86.97
2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======p_roc: 98.71
2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======p_pro: 96.67
2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======threshold: 0.67

2024-03-01 15:11:44.142 | INFO | main:main:152 - carrot=======i_roc: 87.91
2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======p_roc: 99.17
2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======p_pro: 97.04
2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======threshold: 0.65

2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======i_roc: 68.24
2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======p_roc: 98.34
2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======p_pro: 92.17
2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======threshold: 0.59

2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======i_roc: 87.35
2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======p_roc: 98.70
2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======p_pro: 94.65
2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======threshold: 0.51

2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======i_roc: 76.44
2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======p_roc: 85.97
2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======p_pro: 64.17
2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======threshold: 0.60

2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======i_roc: 94.41
2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======p_roc: 99.51
2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======p_pro: 98.45
2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======threshold: 0.73

2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======i_roc: 59.73
2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======p_roc: 99.02
2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======p_pro: 95.48
2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======threshold: 0.51

2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======i_roc: 90.58
2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======p_roc: 99.53
2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======p_pro: 96.43
2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======threshold: 0.42

2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======i_roc: 67.63
2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======p_roc: 98.78
2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======p_pro: 94.89
2024-03-01 15:59:01.166 | INFO | main:main:152 - tire=======threshold: 0.59

这里训练50个epoch的mvtec3d 结果。请问i_roc的结果和您之前跑的差别大吗

[caoyunkang]

您好！结果看起来不太合理，并且aupro和文章报道结果有一定差距。请确认超参数是否为默认配置，以及检查在训练过程中，有无更优的epoch。我会在近期测试所公开的代码并确认性能。