Metrics for comparing two salience maps or two fixation maps. These metrics are implemented in matlab here https://github.com/cvzoya/saliency/tree/master/code_forMetrics . This is just a reimplementation of the metrics in python. The salience benchmark (in matlab) and this code produce the same measures for the same set of inputs.
Metrics implemented are ->
- AUC Judd
- AUC Borji
- AUC shuffled
- NSS
- Info Gain
- SIM
- CC
- KL divergence
The two maps to be compared are gt and s_map. Each method also discretizes (if needed) and normalizes the maps. Details about each of the methods can be found in the MIT Salience Benchmark paper (What do different evaluation metrics tell us about saliency models?)
Citations - @misc{mit-saliency-benchmark, author = {Zoya Bylinskii and Tilke Judd and Fr{'e}do Durand and Aude Oliva and Antonio Torralba}, title = {MIT Saliency Benchmark}, howpublished = {http://saliency.mit.edu/} }
@article{salMetrics_Bylinskii, title = {What do different evaluation metrics tell us about saliency models?}, author = {Zoya Bylinskii and Tilke Judd and Aude Oliva and Antonio Torralba and Fr{'e}do Durand}, journal = {arXiv preprint arXiv:1604.03605}, year = {2016} }