Skip to content

Discrepancy in mAP Results between Provided Model and Self-Trained Model on YTVIS2019 Validation Set #16

@SkyKingL

Description

@SkyKingL

Hello,

I've been experimenting with your VIS model and I've encountered an issue that I hope you can help me clarify.

I trained the model on a server equipped with eight V100-32GB GPUs using the mfvis_nococo/scripts/train_8gpu_mask2former_r50_video.sh script, without any modifications to the parameters. The test results I obtained on the YTVIS2019 validation set are as follows:
微信图片_20240215034541
For comparison, I also tested the trained weight you provided on the same YTVIS2019 validation set and obtained these results:
微信图片_20240215034541
As you can see, there is a minor difference in the mAP scores. I was unable to achieve the mAP=42.5 as reported in your documentation. Could you please provide some insight as to why this discrepancy might be occurring?

I appreciate your time and look forward to your response. Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions