arXiv:2511.21188cs.CVcs.CL2025-11被引 1

动态锚点优化让提示学习更自适应,性能超越部分复杂方法。

AnchorOPT: Towards Optimizing Dynamic Anchors for Adaptive Prompt Learning

  • 锚点值和位置由任务数据动态学习,不再固定
  • 两阶段训练:先学锚点,再优化软令牌与位置矩阵
  • 无需额外模块,插件式接入即提升多数据集表现

现有基于CLIP的提示学习方法使用固定文本锚点引导可学习的软令牌,虽提升泛化能力,但锚点在值和位置上均静态,缺乏跨任务与训练阶段的自适应性。为此,我们提出AnchorOPT,一种基于动态锚点的提示学习框架。该框架在两个关键维度引入动态性:(i) 锚点值不再依赖人工设计的显式文本(如"shape"、"color"),而是从任务特定数据中动态学习;(ii) 锚点与软令牌的相对位置不再固定,通过基于训练阶段和任务上下文的可学习位置矩阵自适应优化。训练分为两阶段:首先学习锚点,然后冻结并传递至第二阶段以优化软令牌与位置矩阵。大量实验表明,仅用一个可学习锚点与位置矩阵即可达到或超越部分包含额外可学习模块或正则化技术的方法。作为即插即用模块,AnchorOPT可无缝集成至现有框架,在多种数据集上持续带来性能提升。代码已公开于https://github.com/zhengli97/ATPrompt。

原文摘要 · Abstract (English)

Existing prompt learning methods, which are built upon CLIP models, leverage textual tokens as anchors to guide the learnable soft tokens. This guidance improves CLIP generalizations. However, these anchors-static in both value and position-lack cross-task and stage-adaptive flexibility. To address this limitation, we propose AnchorOPT, a dynamic anchor-based prompt learning framework. Specifically, AnchorOPT introduces dynamism in two key dimensions: (i) anchor values eschew handcrafted explicit textual tokens (e.g., "shape", "color"), instead learning dynamically from task-specific data; and (ii) the positional relationship between anchor and soft tokens is no longer fixed but adaptively optimized via a learnable position matrix conditioned on the training stage and task context. Training occurs in two stages: we first learn the anchor tokens, then freeze and transfer them to the second stage for optimization of soft tokens and the position matrix. Extensive experiments demonstrate that using only a simple learnable anchor and position matrix achieves performance comparable to or exceeding some methods incorporating additional learnable modules or regularization techniques. As a plug-and-play module, AnchorOPT integrates seamlessly into existing frameworks, yielding consistent performance gains across diverse datasets. Code is publicly available at https://github.com/zhengli97/ATPrompt.

提示学习动态锚点CLIP自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。