用思维链推理提升医学影像分割,解决视觉相似但诊断不同的难题
Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation

- 引入大模型生成的思维链描述构建知识库,指导分割决策
- 通过形态+思维链一致性筛选历史样本,有效避免误判
- 适合处理边界模糊、语义冲突的临床医学图像分割任务
半监督医学图像分割旨在缓解标注稀缺问题,通过在未标注数据上施加一致性正则化。然而现有方法主要依赖像素级视觉相似性,易在视觉-语义不一致场景中失效——即外观相似的病灶可能有不同诊断结论。为此,本文提出CERS(CoT增强推理分割)框架,突破视觉线索限制,引入思维链(CoT)推理来区分病理差异。我们构建由大语言模型生成的语言推理描述构成的知识池,并设计语义感知的参考选择策略:先按形态筛选候选,再通过CoT一致性过滤难负样本。同时,设计多尺度坐标注意力模块(MCAM),将推理生成的上下文信息有效融合到解码过程。大量实验表明,CERS显著优于现有方法,尤其在边界模糊和语义不一致场景中表现优异。代码已开源。
原文摘要 · Abstract (English)
Semi-supervised medical image segmentation has emerged as a dominant research problem in medical image analysis, mitigating annotation scarcity by leveraging consistency regularization on unlabeled data. However, existing approaches operate predominantly via visual pattern matching, relying heavily on pixel-level similarities. This visual-centric dependency often falters in clinical scenarios characterized by the visual-semantic mismatch, where visually similar lesions warrant distinct diagnostic conclusions, thus failing to capture the underlying diagnostic logic used by experts. To address this, we move beyond visual cues and propose CERS (CoT-Enhanced Reasoning Segmentation), a framework that integrates Chain-of-Thought (CoT) reasoning to distinguish pathologically distinct cases. Specifically, we construct a knowledge pool enriched with linguistic reasoning descriptions generated by large language models (LLMs). A semantic-aware reference selection strategy is introduced to identify historical evidence, filtering candidates first by morphology, and then refining them via CoT consistency to eliminate hard negatives. Furthermore, a multi-scale coordinate attention module (MCAM) is designed to effectively fuse this reasoning-derived context into the decoding process. Extensive experiments demonstrate the superiority of CERS against state-of-the-art approaches, particularly in resolving boundary ambiguities and semantic inconsistencies. The code is available at https://github.com/cymasuna/CERS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。