无需训练即可精准分割隐身物体,关键在生成实例级提示。
An Instance-Aware Prompting Framework for Training-free Camouflaged Object Segmentation
- 用无检测器依赖的枚举器生成物体级框提示,提升定位精度。
- 通过区域约束点提示策略,使SAM输出分离的实例掩码。
- 全冻结组件下实现最佳无训练分割效果,适合快速部署。
无训练伪装物体分割(COS)旨在不进行特定任务训练的情况下,通过自动生成视觉提示引导通用分割模型(SAM)。然而现有方法多生成语义级提示,导致输出粗粒度语义掩码,难以有效处理多个离散伪装实例。为此,本文提出首个无训练COS的实例感知提示框架(IAPF),将提示粒度从语义级升级至实例级,同时保持所有组件冻结。核心是实例掩码生成器:(i)采用无检测器依赖的枚举器生成前景标签的精确实例级框提示;(ii)引入单前景多背景提示策略(SFMBP),在每个框内采样区域受限的点提示,使SAM输出实例级掩码。系统还包含一个图像特定文本提示生成器,以及基于同义通用提示的自一致性投票机制以稳定推理。在三个COS基准、两个CIS基准和两个下游数据集上的大量实验表明,该方法在无训练方法中达到领先性能。代码将在接受后公开。
原文摘要 · Abstract (English)
Training-free Camouflaged Object Segmentation (COS) seeks to segment camouflaged objects without task-specific training, by automatically generating visual prompts to guide the Segment Anything Model (SAM). However, existing pipelines mostly yield semantic-level prompts, which drive SAM to coarse semantic masks and struggle to handle multiple discrete camouflaged instances effectively. To address this critical limitation, we propose an \textbf{I}nstance-\textbf{A}ware \textbf{P}rompting \textbf{F}ramework (IAPF) tailored for the first training-free COS that upgrades prompt granularity from semantic to instance-level while keeping all components frozen. The centerpiece is an Instance Mask Generator that (i) leverages a detector-agnostic enumerator to produce precise instance-level box prompts for the foreground tag, and (ii) introduces the Single-Foreground Multi-Background Prompting (SFMBP) strategy to sample region-constrained point prompts within each box prompt, enabling SAM to output instance masks. The pipeline is supported by a simple text prompt generator that produces image-specific tags and a self-consistency vote across synonymous task-generic prompts to stabilize inference. Extensive evaluations on three COS benchmarks, two CIS benchmarks, and two downstream datasets demonstrate state-of-the-art performance among training-free methods. Code will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。