arXiv:2606.03564cs.CVcs.AI2026-06

通过分阶段推理与注意力引导,提升复杂语言描述的图像分割精度

CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation

论文配图:CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
图 1 · 摘自论文原文
  • 分两阶段:先用注意力图粗定位,再选关键点精修掩码
  • 引入全局到局部思维链,解决推理与答案不一致问题
  • 适合需要精准理解复杂语言指令的视觉推理任务

推理分割旨在通过联合视觉-文本推理,分割由复杂语言描述的目标物体。现有方法通常依赖学习到的语义标记连接多模态大模型(MLLM)与分割模型,面临跨模态对齐困难;或使用边界框等显式空间提示,易丢失整体语义信息。为此,我们提出注意力引导且思维链增强的粗到精推理分割框架——CR-Seg。设计提取注意力图与关键点(EAP)模块,生成粗略目标定位图和重要位置点,输入SAM进行掩码精修。为缓解推理与输出不一致问题,进一步引入全局到局部思维链(GLCoT),引导模型从场景整体上下文逐步推理至目标局部细节。在多个推理分割基准上的大量实验验证了CR-Seg的有效性。

原文摘要 · Abstract (English)

Reasoning segmentation aims to segment target objects described by complex language through joint visual-textual reasoning. Existing methods typically rely on either learned semantic tokens to bridge Multimodal Large Language Models (MLLMs) and segmentation models, suffering from difficult cross-modal alignment, or explicit spatial prompts such as bounding boxes, which may lose holistic response semantics. To address these limitations, we propose Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation, termed CR-Seg, a two-stage framework for coarse-to-refined reasoning segmentation. Specifically, we design an Extract Attention Maps and Points (EAP) module to extract attention maps for coarse target localization and select informative points, both of which are fed into SAM for mask refinement. To alleviate reasoning--answer inconsistency, we further introduce Global-to-Local Chain-of-Thought (GLCoT), which guides the model to reason progressively from global scene context to local target details. Extensive experiments on reasoning segmentation benchmarks demonstrate the effectiveness of CR-Seg.

推理分割多模态思维链注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。