arXiv:2505.04575cs.CVcs.LG2025-05ICML被引 12

解决跨域增量学习中提示词知识错位问题,提升模型持续学习能力。

Componential Prompt-Knowledge Alignment for Domain Incremental Learning

  • 通过组件级对齐机制,动态优化新旧提示词间知识关联
  • 在多个基准上实现优于现有方法的性能,显著降低错误率
  • 适合需要长期稳定学习的新旧知识融合场景

领域增量学习(DIL)旨在从非平稳数据流中跨领域持续学习,同时保留并利用历史知识。尽管基于提示的方法能将多领域知识存储于提示参数中,并通过跨域提示融合获得先进性能,但我们发现其存在内在局限:领域专属提示之间的组件级错位导致知识冲突与预测下降。这源于知识组件在提示中随机分布,无关组件的融合引入干扰。为此,我们提出组件级提示-知识对齐方法(KA-Prompt),在训练中引入组件感知的提示-知识对齐机制,显著提升模型的学习与推理能力。KA-Prompt包含两个阶段:(1) 初始组件结构配置,通过贪心搜索挖掘与新领域相关的历史提示,用于初始化新提示,实现可复用的知识迁移并建立新旧提示间的内在对齐;(2) 在线对齐保持,动态识别目标旧提示,并随新提示演化施加自适应组件一致性约束。在DIL基准上的大量实验验证了KA-Prompt的有效性。源代码已公开于https://github.com/zhoujiahuan1991/ICML2025-KA-Prompt。

原文摘要 · Abstract (English)

Domain Incremental Learning (DIL) aims to learn from non-stationary data streams across domains while retaining and utilizing past knowledge. Although prompt-based methods effectively store multi-domain knowledge in prompt parameters and obtain advanced performance through cross-domain prompt fusion, we reveal an intrinsic limitation: component-wise misalignment between domain-specific prompts leads to conflicting knowledge integration and degraded predictions. This arises from the random positioning of knowledge components within prompts, where irrelevant component fusion introduces interference.To address this, we propose Componential Prompt-Knowledge Alignment (KA-Prompt), a novel prompt-based DIL method that introduces component-aware prompt-knowledge alignment during training, significantly improving both the learning and inference capacity of the model. KA-Prompt operates in two phases: (1) Initial Componential Structure Configuring, where a set of old prompts containing knowledge relevant to the new domain are mined via greedy search, which is then exploited to initialize new prompts to achieve reusable knowledge transfer and establish intrinsic alignment between new and old prompts. (2) Online Alignment Preservation, which dynamically identifies the target old prompts and applies adaptive componential consistency constraints as new prompts evolve. Extensive experiments on DIL benchmarks demonstrate the effectiveness of our KA-Prompt. Our source code is available at https://github.com/zhoujiahuan1991/ICML2025-KA-Prompt

增量学习提示工程知识对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。