Scribbles algorithm

[hw-ju]

Hi!
Just curious what algorithm is used behind the Scribbles feature. Is it deep learning based?

[tangy5]

Hi @hw-ju , yes, it's deep learning and statistic based algorithm. It's a AI-assisted correction tool, the scribble-based interactive segmentation correction can allow you to set ROIs for foreground/background, so that can update inference and correct annotation.

[hw-ju]

Thanks for your prompt response @tangy5!
Could you point me to maybe a publication/documentation on the Scribble algorithm? Just curious about the details of that algorithm?

[diazandr3s]

Good question, @hw-ju.
You can find all the information and reference articles about the scribbles algorithm here: https://github.com/Project-MONAI/MONAILabel/wiki/Scribbles
From what I understand the implemented algorithm in MONAI Label is not a deep-learning model. It is rather a machine learning model that uses Gaussian mixture models or energy functions.
Hope that helps.

[hw-ju]

Thanks @diazandr3s! Very helpful!

[Zrrr1997]

If you are still interested in a paper behind such interactive statistical approaches - this is the seminal Graph Cut paper link. Classical approaches utilized pixel-level features regarding appearance and spatial distance to separate foreground from background. Such is also the foundation for energy-based optimization methods, such as CRFs (seminal paper). Both papers are a great read, especially if you enjoy reading about classical non-deep learning methods.

[hw-ju]

@Zrrr1997 Thanks for pointing to the seminal papers!