where are metrics calculated? in which python file

[cyj95]

after anomalib fit --config ./configs/model/patchcore.yaml
i got

in config file,i see
metrics:
image_metrics:
- F1Score
- AUROC
pixel_metrics:
- F1Score
- AUROC

plz help me find
where are metrics calculated? in which python file

[samet-akcay]

@cyj95, when the training is triggered, MetricConfigurationCallback is initialized. This creates and sets the image and pixel metrics to the anomaly module. Since this is a standard procedure for all the models in this library, we store these attributes in the base AnomalyModule.

The metrics are then computed in validation_epoch_end method of the same module. Hope this helps. Let me know if you have any other questions.

[cyj95]

I found “anomalib/utils/metrics/auroc.py” file，but I didn't find where AUROC is used?
And which file displays this result?

[ashwinvaidya17]

For the second question, the metrics object is logged in _log_metrics function in the base anomaly module anomalib/modules/components/base/anomaly_module.py. PyTorch Lightning is responsible for displaying the metrics logged using self.log_dict. Maybe this might help https://pytorch-lightning.readthedocs.io/en/stable/common/lightning_module.html#log-dict