用大模型分割膝关节半月板,效果不如传统网络
Putting the Segment Anything Model to the Test with 3D Knee MRI - A Comparison with State-of-the-Art Performance
- 将SAM模型用于3D膝关节MRI的半月板自动分割
- 端到端微调后Dice达0.87,与3D U-Net相当
- 对低对比度、边界模糊结构分割能力有限
半月板是膝关节内负责润滑与承重分散的软骨组织,损伤可导致膝关节骨性关节炎(OA)的发生与进展,而目前缺乏有效治疗手段。准确的自动化分割有助于早期发现异常并揭示半月板在OA中的作用。以往研究多采用卷积神经网络变体,但未尝试使用近期大型视觉变换器分割模型。本文将通用分割模型Segment Anything Model(SAM)适配至3D膝关节MRI的半月板分割任务,并以3D U-Net作为基线。仅微调解码器时,SAM Dice得分为0.81±0.03,低于3D U-Net的0.87±0.03;端到端微调后,SAM达到0.87±0.03,与3D U-Net性能相当,均接近IWOAI 2019挑战赛冠军分数(0.88±0.03)。但在豪斯多夫距离指标上,两种SAM配置均劣于3D U-Net,难以精准捕捉半月板形态。结果表明,尽管SAM具备强泛化能力,却未能超越基础3D U-Net,在涉及低对比度、边界模糊的精细解剖结构分割任务中表现受限。
原文摘要 · Abstract (English)
Menisci are cartilaginous tissue found within the knee that contribute to joint lubrication and weight dispersal. Damage to menisci can lead to onset and progression of knee osteoarthritis (OA), a condition that is a leading cause of disability, and for which there are few effective therapies. Accurate automated segmentation of menisci would allow for earlier detection and treatment of meniscal abnormalities, as well as shedding more light on the role the menisci play in OA pathogenesis. Focus in this area has mainly used variants of convolutional networks, but there has been no attempt to utilise recent large vision transformer segmentation models. The Segment Anything Model (SAM) is a so-called foundation segmentation model, which has been found useful across a range of different tasks due to the large volume of data used for training the model. In this study, SAM was adapted to perform fully-automated segmentation of menisci from 3D knee magnetic resonance images. A 3D U-Net was also trained as a baseline. It was found that, when fine-tuning only the decoder, SAM was unable to compete with 3D U-Net, achieving a Dice score of $0.81\pm0.03$, compared to $0.87\pm0.03$, on a held-out test set. When fine-tuning SAM end-to-end, a Dice score of $0.87\pm0.03$ was achieved. The performance of both the end-to-end trained SAM configuration and the 3D U-Net were comparable to the winning Dice score ($0.88\pm0.03$) in the IWOAI Knee MRI Segmentation Challenge 2019. Performance in terms of the Hausdorff Distance showed that both configurations of SAM were inferior to 3D U-Net in matching the meniscus morphology. Results demonstrated that, despite its generalisability, SAM was unable to outperform a basic 3D U-Net in meniscus segmentation, and may not be suitable for similar 3D medical image segmentation tasks also involving fine anatomical structures with low contrast and poorly-defined boundaries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。