arXiv:2506.06818cs.CV2025-06中稿 · ACM MM2025被引 4

无需训练即可精准分割隐蔽目标,提升准确率与速度

Stepwise Decomposition and Dual-stream Focus: A Novel Approach for Training-free Camouflaged Object Segmentation

  • 通过分步分解文本提示消除语义歧义
  • 双流视觉提示结合空间约束,避免误分割
  • 纯推理框架,适合快速部署于实际场景

尽管可提示分割(如SAM)在多种任务中表现良好,但需为每个对象手动提供视觉提示。而通用提示分割旨在仅用一个通用提示指导所有测试样本的分割。然而,当应用于隐蔽目标分割(COS)时,现有方法仍存在两大问题:一是实例级文本提示存在语义模糊,源于整体描述缺乏区分性线索,导致前景与背景混淆;二是实例级视觉提示存在语义差异与空间分离,源于远离目标边界的全局背景采样,特征相关性低,导致SAM分割无关区域。为此,我们提出RDVP-MSD——一种新型无训练测试时自适应框架,通过多模态分步分解思维链(MSD-CoT)协同区域约束双流视觉提示(RDVP)。MSD-CoT逐步解构图像描述以消除语义歧义,而RDVP将空间约束引入视觉提示,并分别对前景与背景点独立采样,有效缓解语义差异与空间分离问题。无需任何训练或监督,RDVP-MSD在多个COS基准上达到当前最优性能,且推理速度优于此前方法,显著提升准确率与效率。代码将在https://github.com/ycyinchao/RDVP-MSD公开。

原文摘要 · Abstract (English)

While promptable segmentation (\textit{e.g.}, SAM) has shown promise for various segmentation tasks, it still requires manual visual prompts for each object to be segmented. In contrast, task-generic promptable segmentation aims to reduce the need for such detailed prompts by employing only a task-generic prompt to guide segmentation across all test samples. However, when applied to Camouflaged Object Segmentation (COS), current methods still face two critical issues: 1) \textit{\textbf{semantic ambiguity in getting instance-specific text prompts}}, which arises from insufficient discriminative cues in holistic captions, leading to foreground-background confusion; 2) \textit{\textbf{semantic discrepancy combined with spatial separation in getting instance-specific visual prompts}}, which results from global background sampling far from object boundaries with low feature correlation, causing SAM to segment irrelevant regions. To address the issues above, we propose \textbf{RDVP-MSD}, a novel training-free test-time adaptation framework that synergizes \textbf{R}egion-constrained \textbf{D}ual-stream \textbf{V}isual \textbf{P}rompting (RDVP) via \textbf{M}ultimodal \textbf{S}tepwise \textbf{D}ecomposition Chain of Thought (MSD-CoT). MSD-CoT progressively disentangles image captions to eliminate semantic ambiguity, while RDVP injects spatial constraints into visual prompting and independently samples visual prompts for foreground and background points, effectively mitigating semantic discrepancy and spatial separation. Without requiring any training or supervision, RDVP-MSD achieves a state-of-the-art segmentation result on multiple COS benchmarks and delivers a faster inference speed than previous methods, demonstrating significantly improved accuracy and efficiency. The codes will be available at \href{https://github.com/ycyinchao/RDVP-MSD}{https://github.com/ycyinchao/RDVP-MSD}

隐蔽目标分割无训练分割视觉提示多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。