arXiv:2606.28149cs.CVcs.AI2026-06

用语义概念引导实现更稳定的图像分割,减少参考图变化带来的结果波动。

Toward Robust In-Context Segmentation via Concept Guidance

  • 通过提取参考图的高层语义概念代替低层视觉匹配
  • 在标准基准上达到顶尖精度且分割结果方差显著降低
  • 适合需要稳定推理的医疗、遥感等实际场景应用

上下文分割(ICS)要求模型仅使用少量参考图像及其掩码,在不更新参数的情况下分割查询图像中的目标区域。尽管近期取得进展,现有研究普遍忽视了系统鲁棒性——即同一查询在不同参考下是否能产生稳定分割结果。本文从鲁棒性视角重新审视ICS,提出概念引导的上下文分割(CG-ICS)新范式:通过多模态大模型提取参考图的高层语义概念,结合SAM3驱动的树搜索评分函数筛选可靠文本概念,并并行引入视觉实例路径提供查询侧空间定位。最终由冻结的SAM3主干激活分割能力。大量实验表明,CG-ICS不仅在标准评测集上达到当前最优性能,且在多种参考选择下显著降低结果方差,大幅提升系统可靠性。代码已开源。

原文摘要 · Abstract (English)

In-context segmentation (ICS) requires a model to segment target regions in a query image using only a few reference images and their corresponding masks, without updating any parameters. Despite recent progress, prior ICS studies have largely overlooked a critical aspect: system robustness, ie, whether the model can produce stable segmentation results for the same query under different references. In this work, we revisit ICS from the robustness perspective and introduce a novel paradigm, Concept-Guided In-Context Segmentation (CG-ICS), which performs segmentation by extracting high-level semantic concepts from references rather than relying solely on low-level visual matching. Specifically, CG-ICS introduces a concept reasoning module that uses an MLLM to propose candidates and a SAM3-driven scoring function with tree-search refinement to select reliable textual concepts, together with a parallel visual exemplar route that provides query-side spatial grounding via a simple context construction. Both the textual concept and the visual exemplar are then used to activate the segmentation capability of a frozen SAM3 backbone. Extensive experiments on standard ICS benchmarks demonstrate that CG-ICS not only achieves state-of-the-art accuracy but also substantially improves robustness, yielding a more reliable ICS system with significantly reduced variance across diverse reference choices. Code is available at https://github.com/Kakarot1103/CG-ICS.

图像分割上下文学习语义引导鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。