构建3D医学影像交互分割基准,验证通用模型优于专用模型
RadioActive: 3D Radiological Interactive Segmentation Benchmark
- 设计可扩展代码库,支持2D/3D模型公平对比
- 仅需少量交互即达高精度,SAM2超越专业医疗模型
- 适合医学图像算法研究者与临床辅助系统开发者
无需大量人工干预即可实现精准分割,将极大提升临床工作流效率。尽管受启发于METAS Segment Anything的交互分割模型已取得进展,但在3D放射学场景中仍面临严重局限:如对2D模型处理3D数据需逐切片操作、缺乏迭代优化能力;且以往研究受限于评估协议不统一,导致性能评估不可靠、结论不一致。本文提出的RadioActive基准通过提供严谨可复现的评估框架,解决上述问题。它涵盖多样数据集、广泛目标结构,并集成当前最具影响力的2D与3D交互分割方法,配套灵活可扩展的代码库。我们还引入先进提示技术,减少交互步骤,实现2D与3D模型的公平比较。令人意外的是,在仅需少数交互生成3D体数据提示的设定下,SAM2表现优于所有专用于医疗的2D与3D模型,挑战了现有认知,证明通用模型在医学领域更具优势。通过开源RadioActive,我们邀请研究者持续集成新模型与提示策略,推动3D医疗交互模型的透明化评估。
原文摘要 · Abstract (English)
Effortless and precise segmentation with minimal clinician effort could greatly streamline clinical workflows. Recent interactive segmentation models, inspired by METAs Segment Anything, have made significant progress but face critical limitations in 3D radiology. These include impractical human interaction requirements such as slice-by-slice operations for 2D models on 3D data and a lack of iterative refinement. Prior studies have been hindered by inadequate evaluation protocols, resulting in unreliable performance assessments and inconsistent findings across studies. The RadioActive benchmark addresses these challenges by providing a rigorous and reproducible evaluation framework for interactive segmentation methods in clinically relevant scenarios. It features diverse datasets, a wide range of target structures, and the most impactful 2D and 3D interactive segmentation methods, all within a flexible and extensible codebase. We also introduce advanced prompting techniques that reduce interaction steps, enabling fair comparisons between 2D and 3D models. Surprisingly, SAM2 outperforms all specialized medical 2D and 3D models in a setting requiring only a few interactions to generate prompts for a 3D volume. This challenges prevailing assumptions and demonstrates that general-purpose models surpass specialized medical approaches. By open-sourcing RadioActive, we invite researchers to integrate their models and prompting techniques, ensuring continuous and transparent evaluation of 3D medical interactive models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。