RetrievalMRR when non of the targets was correctly retrieved

[matanat]

Hi,
I'm a bit confused about the Mean Reciprocal Rank implementation.
Based on wikipedia:

If none of the proposed results are correct, reciprocal rank is 0

But if I run:

mrr = torchmetrics.RetrievalMRR()

preds = torch.tensor([0.0, 0.0, 0.0])
indexes = torch.tensor([0, 0, 0])
target = torch.tensor([1, 0, 0])

mrr(preds, target, indexes=indexes)

I get tensor(1.) when expecting to get 0.

Am I misunderstanding something?

[celsofranssa]

Hello @matanat,

I had a discussion about it, and I am still confused. Have you tried implementing it by yourself (using these guidelines)?