arXiv:2411.15513eess.IVcs.CV2024-11ICCV被引 2

让医学影像分割模型高效适应用户偏好,减少人工操作

SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentation

  • 生成少数几个有代表性的分割结果,供用户选择
  • 用户反馈后模型可快速调整偏好,提升适配性
  • 适合临床场景中需灵活调整分割标准的医生使用

医学图像分割数据天然存在不确定性,源于图像质量不全及标注者对模糊像素的偏好差异,这种差异取决于标注者经验和临床背景。例如,边界像素在诊断中可能被标为肿瘤以避免低估病情,而在放疗中则可能标为正常组织以保护敏感结构。由于下游任务需求不同,理想分割模型应具备用户可调输出能力。现有不确定感知和交互式方法在测试时效率低下:前者需用户从大量相似结果中筛选,后者依赖大量点击或框选输入。为此,我们提出SPA(Segmentation Preference Alignment)框架,通过提供少数几个能最好体现不确定性的显著分割候选结果,大幅降低用户工作量。该框架引入概率机制,利用用户反馈动态调整模型分割偏好。在彩色眼底图、肺结节与肾部CT、脑部及前列腺MRI等多类任务上评估显示:相比现有交互式方法,SPA显著减少用户时间和精力;基于人类反馈具有强适应性;并在多种成像模态与语义标签下达到当前最佳分割性能。

原文摘要 · Abstract (English)

Medical image segmentation data inherently contain uncertainty. This can stem from both imperfect image quality and variability in labeling preferences on ambiguous pixels, which depend on annotator expertise and the clinical context of the annotations. For instance, a boundary pixel might be labeled as tumor in diagnosis to avoid under-estimation of severity, but as normal tissue in radiotherapy to prevent damage to sensitive structures. As segmentation preferences vary across downstream applications, it is often desirable for an image segmentation model to offer user-adaptable predictions rather than a fixed output. While prior uncertainty-aware and interactive methods offer adaptability, they are inefficient at test time: uncertainty-aware models require users to choose from numerous similar outputs, while interactive models demand significant user input through click or box prompts to refine segmentation. To address these challenges, we propose \textbf{SPA}, a new \textbf{S}egmentation \textbf{P}reference \textbf{A}lignment framework that efficiently adapts to diverse test-time preferences with minimal human interaction. By presenting users with a select few, distinct segmentation candidates that best capture uncertainties, it reduces the user workload to reach the preferred segmentation. To accommodate user preference, we introduce a probabilistic mechanism that leverages user feedback to adapt a model's segmentation preference. The proposed framework is evaluated on several medical image segmentation tasks: color fundus images, lung lesion and kidney CT scans, MRI scans of brain and prostate. SPA shows 1) a significant reduction in user time and effort compared to existing interactive segmentation approaches, 2) strong adaptability based on human feedback, and 3) state-of-the-art image segmentation performance across different imaging modalities and semantic labels.

医学影像分割优化用户偏好不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。