| <img src="images/img60.png" width="900"> |<li> Title: <a href="https://link.springer.com/chapter/10.1007/978-3-031-72111-3_70">TP-DRSeg: Improving Diabetic Retinopathy Lesion Segmentation with Explicit Text-Prompts Assisted SAM</a></li> <li>Publication: MICCAI 2024 </li> <li>Summary: Propose a framework that customizes SAM for text-prompted Diabetic Retinopathy lesion segmentation, termed TP-DRSeg, which exploits language cues to inject medical prior knowledge into the vision-only segmentation network, thereby combining the advantages of different foundation models and enhancing the credibility of segmentation. To unleash the potential of vision-language models in the recognition of medical concepts, it utlizes an explicit prior encoder that transfers implicit medical concepts into explicit prior knowledge, providing explainable clues to excavate low-level features associated with lesions. Furthermore, a prior-aligned injector is designed to inject explicit priors into the segmentation process, which can facilitate knowledge sharing across multi-modality features and allow the framework to be trained in a parameter-efficient fashion. </li> <li>Code: <a href="https://github.com/wxliii/TP-DRSeg">https://github.com/wxliii/TP-DRSeg</a>|
0 commit comments