Hi there! In the function corresponding to NDCG calculation I noticed that ignore_rank_of_non_annotated_urls flag is present.
|
ignore_rank_of_non_annotated_urls: bool=True) -> float: |
The question is: are your results in the paper calculated with ignore_rank_of_non_annotated_urls=True?