arXiv:2503.06717cs.CV2025-03中稿 · ICLR被引 2

用户点击引导模型在线更新,提升医学影像分割对分布偏移的适应能力。

You Point, I Learn: Online Adaptation of Interactive Segmentation Models for Handling Distribution Shifts in Medical Imaging

  • 利用用户点击反馈构建伪标签,实现模型在线迭代优化。
  • 在5个眼底图与4个脑MRI数据集上均显著优于现有方法。
  • 适合医疗影像领域需实时交互与动态适应的场景。

交互式分割通过实时用户输入(如鼠标点击)逐步优化模型预测。尽管最初并非为应对分布偏移设计,该范式天然适用于此类挑战。在医学影像中,分布偏移常见,交互方法可借助用户输入引导模型向更优预测收敛。部署后,用户修正可用于调整网络参数以适应新数据分布。基于此,我们提出一种实用有效的交互式分割模型在线适应方法。首先发现增强模型对点击的响应性对初始训练至关重要;其次,将交互后用户修正的输出作为伪真值,设计轻量级在线适应机制,使模型能有效学习连续测试图像。框架包含两个组件:(i) 交互后适应,用户完成图像修正后更新模型;(ii) 交互中适应,每次点击后增量更新。两者均引入以点击为中心的高斯损失,强化模型对点击的响应并聚焦于用户引导的临床相关区域。在5个眼底图与4个脑MRI数据库上的实验表明,本方法在多种分布偏移下(包括未见成像模态与病灶类型)持续优于现有方法。代码与预训练模型将在发表后公开。

原文摘要 · Abstract (English)

Interactive segmentation uses real-time user inputs, such as mouse clicks, to iteratively refine model predictions. Although not originally designed to address distribution shifts, this paradigm naturally lends itself to such challenges. In medical imaging, where distribution shifts are common, interactive methods can use user inputs to guide models towards improved predictions. Moreover, once a model is deployed, user corrections can be used to adapt the network parameters to the new data distribution, mitigating distribution shift. Based on these insights, we aim to develop a practical, effective method for improving the adaptive capabilities of interactive segmentation models to new data distributions in medical imaging. Firstly, we found that strengthening the model's responsiveness to clicks is important for the initial training process. Moreover, we show that by treating the post-interaction user-refined model output as pseudo-ground-truth, we can design a lean, practical online adaptation method that enables a model to learn effectively across sequential test images. The framework includes two components: (i) a Post-Interaction adaptation process, updating the model after the user has completed interactive refinement of an image, and (ii) a Mid-Interaction adaptation process, updating incrementally after each click. Both processes include a Click-Centered Gaussian loss that strengthens the model's reaction to clicks and enhances focus on user-guided, clinically relevant regions. Experiments on 5 fundus and 4 brain-MRI databases show that our approach consistently outperforms existing methods under diverse distribution shifts, including unseen imaging modalities and pathologies. Code and pretrained models will be released upon publication.

医学影像交互分割在线学习分布偏移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。