arXiv:2504.14254cs.CV2025-04CVPR被引 5

用轻量提示词让预训练模型更好找共显著目标,效果超越13个主流方法。

Visual Consensus Prompting for Co-Salient Object Detection

  • 设计可学习的视觉共识提示,仅微调少量参数,实现高效交互
  • 在CoCA数据集上F_m指标提升6.8%,达到新SOTA
  • 适合想快速部署且节省算力的视觉任务研究者

现有共显著目标检测方法普遍采用编码-共识提取与分散-预测三阶段架构,并使用全参数微调。但该方法存在两个问题:一是共识提取依赖编码特征,却无法及时指导编码阶段;二是全参数更新效率低,难以有效利用基础模型的知识。为此,本文提出一种交互高效、参数高效的简洁架构,首次引入轻量级提示调优范式,将共识信息嵌入提示中,形成面向任务的视觉共识提示(VCP)。通过有限可训练参数聚焦共显著特征,生成一致提示,再由提示扩散模块激发预训练模型在该任务上的潜力。大量实验表明,所提VCP优于13种先进全微调模型,在最困难的CoCA数据集上F_m指标提升6.8%,达到新SOTA。代码已开源。

原文摘要 · Abstract (English)

Existing co-salient object detection (CoSOD) methods generally employ a three-stage architecture (i.e., encoding, consensus extraction & dispersion, and prediction) along with a typical full fine-tuning paradigm. Although they yield certain benefits, they exhibit two notable limitations: 1) This architecture relies on encoded features to facilitate consensus extraction, but the meticulously extracted consensus does not provide timely guidance to the encoding stage. 2) This paradigm involves globally updating all parameters of the model, which is parameter-inefficient and hinders the effective representation of knowledge within the foundation model for this task. Therefore, in this paper, we propose an interaction-effective and parameter-efficient concise architecture for the CoSOD task, addressing two key limitations. It introduces, for the first time, a parameter-efficient prompt tuning paradigm and seamlessly embeds consensus into the prompts to formulate task-specific Visual Consensus Prompts (VCP). Our VCP aims to induce the frozen foundation model to perform better on CoSOD tasks by formulating task-specific visual consensus prompts with minimized tunable parameters. Concretely, the primary insight of the purposeful Consensus Prompt Generator (CPG) is to enforce limited tunable parameters to focus on co-salient representations and generate consensus prompts. The formulated Consensus Prompt Disperser (CPD) leverages consensus prompts to form task-specific visual consensus prompts, thereby arousing the powerful potential of pre-trained models in addressing CoSOD tasks. Extensive experiments demonstrate that our concise VCP outperforms 13 cutting-edge full fine-tuning models, achieving the new state of the art (with 6.8% improvement in F_m metrics on the most challenging CoCA dataset). Source code has been available at https://github.com/WJ-CV/VCP.

目标检测提示调优轻量模型视觉共识

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。