arXiv:2506.18404eess.IV2025-06被引 4

让医生点错也能准分割,医疗影像智能勾画更靠谱

SafeClick: Error-Tolerant Interactive Segmentation of Any Medical Volumes via Hierarchical Expert Consensus

  • 用多专家协同+共识推理,自动修复用户不准确点击
  • 在15个数据集上显著提升基础模型性能,尤其对错误提示效果好
  • 可直接接入SAM2等模型,适合临床实际使用场景

用于体积分割的基座模型已成为临床工作流中的强大工具,使放射科医生可通过直观点击勾画感兴趣区域。尽管这些模型在分割未见过的解剖结构方面表现出色,但其性能受提示质量影响显著。在临床中,医生常提供不理想的提示,影响分割的可靠性与准确性。为此,我们提出SafeClick,一种基于分层专家共识的容错交互式体积分割方法。SafeClick作为即插即用模块,兼容SAM2和MedSAM2等基座模型。框架包含两个核心组件:协作专家层(CEL)通过专用Transformer模块生成多样化特征表示,共识推理层(CRL)实现特征间的交叉验证与自适应融合。该架构将分割过程从依赖提示转变为对不完美输入具有鲁棒性的系统。在15个公开数据集上的大量实验表明,该即插即用方法持续提升基础模型性能,尤其在处理不理想提示时提升显著。源代码已开源:https://github.com/yifangao112/SafeClick。

原文摘要 · Abstract (English)

Foundation models for volumetric medical image segmentation have emerged as powerful tools in clinical workflows, enabling radiologists to delineate regions of interest through intuitive clicks. While these models demonstrate promising capabilities in segmenting previously unseen anatomical structures, their performance is strongly influenced by prompt quality. In clinical settings, radiologists often provide suboptimal prompts, which affects segmentation reliability and accuracy. To address this limitation, we present SafeClick, an error-tolerant interactive segmentation approach for medical volumes based on hierarchical expert consensus. SafeClick operates as a plug-and-play module compatible with foundation models including SAM 2 and MedSAM 2. The framework consists of two key components: a collaborative expert layer (CEL) that generates diverse feature representations through specialized transformer modules, and a consensus reasoning layer (CRL) that performs cross-referencing and adaptive integration of these features. This architecture transforms the segmentation process from a prompt-dependent operation to a robust framework capable of producing accurate results despite imperfect user inputs. Extensive experiments across 15 public datasets demonstrate that our plug-and-play approach consistently improves the performance of base foundation models, with particularly significant gains when working with imperfect prompts. The source code is available at https://github.com/yifangao112/SafeClick.

医学影像交互分割容错设计专家共识

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。