arXiv:2502.10559eess.IVcs.AI2025-02被引 3

基于记忆的AI模型实现膝关节软骨与半月板精准分割,大幅降低标注工作量。

SAMRI-2: A Memory-based Model for Cartilage and Meniscus Segmentation in 3D MRIs of the Knee Joint

  • 采用记忆机制与混合打乱策略提升模型空间感知与收敛速度。
  • 在外部数据集上平均骰子系数提升5点,胫骨软骨最高提升12点。
  • 仅需3次点击即可完成分割,适合临床高效精准标注需求。

通过MRI进行软骨形态测量(如厚度、体积)对监测膝关节骨关节炎至关重要。软骨分割仍具挑战性,且依赖大量专家标注数据,易受阅片者间差异影响。近期视觉基础模型(VFM),尤其是基于记忆的方法,为提升泛化性与鲁棒性提供了新可能。本研究提出一种基于交互式记忆型VFM的深度学习方法,用于3D膝关节MRI中的软骨与半月板分割。为增强空间感知与训练收敛,引入混合打乱策略(HSS)并采用分割掩码传播技术以提高标注效率。在270例患者的3D膝关节MRI数据上训练了四种模型:基于CNN的3D-VNet、两个自动Transformer模型(SaMRI2D与SaMRI3D),以及一个可提示的Transformer记忆型VFM(SAMRI-2),并在57个外部病例上评估,涵盖多放射科医生标注与不同扫描协议。性能以骰子系数(DSC)和交并比(IoU)对比参考标准,并辅以形态学评估量化精度。SAMRI-2模型在使用HSS训练后表现最优,平均DSC提升5点,胫骨软骨最高提升12点;同时软骨厚度误差最低,最大减少三倍。尤其值得注意的是,该模型仅需每体积3次用户点击即保持高精度,显著降低标注负担。此具有空间感知能力的记忆型VFM为膝关节MRI的可靠AI辅助分割提供了新范式,推动骨骼肌肉影像深度学习发展。

原文摘要 · Abstract (English)

Accurate morphometric assessment of cartilage-such as thickness/volume-via MRI is essential for monitoring knee osteoarthritis. Segmenting cartilage remains challenging and dependent on extensive expert-annotated datasets, which are heavily subjected to inter-reader variability. Recent advancements in Visual Foundational Models (VFM), especially memory-based approaches, offer opportunities for improving generalizability and robustness. This study introduces a deep learning (DL) method for cartilage and meniscus segmentation from 3D MRIs using interactive, memory-based VFMs. To improve spatial awareness and convergence, we incorporated a Hybrid Shuffling Strategy (HSS) during training and applied a segmentation mask propagation technique to enhance annotation efficiency. We trained four AI models-a CNN-based 3D-VNet, two automatic transformer-based models (SaMRI2D and SaMRI3D), and a transformer-based promptable memory-based VFM (SAMRI-2)-on 3D knee MRIs from 270 patients using public and internal datasets and evaluated on 57 external cases, including multi-radiologist annotations and different data acquisitions. Model performance was assessed against reference standards using Dice Score (DSC) and Intersection over Union (IoU), with additional morphometric evaluations to further quantify segmentation accuracy. SAMRI-2 model, trained with HSS, outperformed all other models, achieving an average DSC improvement of 5 points, with a peak improvement of 12 points for tibial cartilage. It also demonstrated the lowest cartilage thickness errors, reducing discrepancies by up to threefold. Notably, SAMRI-2 maintained high performance with as few as three user clicks per volume, reducing annotation effort while ensuring anatomical precision. This memory-based VFM with spatial awareness offers a novel approach for reliable AI-assisted knee MRI segmentation, advancing DL in musculoskeletal imaging.

医学影像分割模型记忆机制膝关节

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。