arXiv:2507.08357cs.CV2025-07

通过循环验证提升医疗图像分割的上下文对齐,无需微调即可增强模型泛化能力。

Cycle Context Verification for In-Context Medical Image Segmentation

  • 设计循环验证机制,用反向预测检验初始分割结果的可靠性。
  • 在7个数据集上优于现有方法,显著提升跨模态分割性能。
  • 适合无标注数据场景,尤其适用于计算资源受限的临床部署。

上下文学习(ICL)正成为实现通用医疗图像分割的有前景技术,使单一模型可分割多种成像模态下的目标。然而其性能高度依赖查询图像与上下文图像-掩码对之间的对齐程度。临床上标注数据稀缺,难以选择最优上下文对;且因计算成本高和灾难性遗忘风险,无法对基础ICL模型进行微调。为此,本文提出循环上下文验证(CCV),通过自验证机制增强ICL医学图像分割中的上下文对齐。具体而言,CCV采用循环流程:模型先对查询图像生成分割掩码;随后交换查询图像与一个上下文对的角色,让模型预测原上下文图像的掩码;该二次预测的准确性作为初始分割结果的隐式评估指标。引入查询特定提示调整查询图像并更新,以优化该度量,从而改善查询与上下文对之间的对齐。我们在两个ICL基础模型上,在七个医疗图像分割数据集上评估了CCV,结果表明其显著优于现有方法。实验验证了CCV在提升基于ICL的分割鲁棒性方面的有效性,为通用医疗图像分割提供可靠解决方案。代码将开源于 https://github.com/ShishuaiHu/CCV。

原文摘要 · Abstract (English)

In-context learning (ICL) is emerging as a promising technique for achieving universal medical image segmentation, where a variety of objects of interest across imaging modalities can be segmented using a single model. Nevertheless, its performance is highly sensitive to the alignment between the query image and in-context image-mask pairs. In a clinical scenario, the scarcity of annotated medical images makes it challenging to select optimal in-context pairs, and fine-tuning foundation ICL models on contextual data is infeasible due to computational costs and the risk of catastrophic forgetting. To address this challenge, we propose Cycle Context Verification (CCV), a novel framework that enhances ICL-based medical image segmentation by enabling self-verification of predictions and accordingly enhancing contextual alignment. Specifically, CCV employs a cyclic pipeline in which the model initially generates a segmentation mask for the query image. Subsequently, the roles of the query and an in-context pair are swapped, allowing the model to validate its prediction by predicting the mask of the original in-context image. The accuracy of this secondary prediction serves as an implicit measure of the initial query segmentation. A query-specific prompt is introduced to alter the query image and updated to improve the measure, thereby enhancing the alignment between the query and in-context pairs. We evaluated CCV on seven medical image segmentation datasets using two ICL foundation models, demonstrating its superiority over existing methods. Our results highlight CCV's ability to enhance ICL-based segmentation, making it a robust solution for universal medical image segmentation. The code will be available at https://github.com/ShishuaiHu/CCV.

医学图像上下文学习分割自验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。