提出WAVE++,用自适应提示捕捉任务内差异,解决持续关系抽取中的遗忘与身份识别难题。
WAVE++: Capturing Within-Task Variance for Continual Relation Extraction with Adaptive Prompting
- 设计任务专属提示池,灵活应对任务内与跨任务变化
- 引入标签描述和生成模型,提升分类准确率并避免存储历史数据
- 无需训练即可推理任务身份,适合隐私敏感场景
基于记忆的方法在持续关系抽取(CRE)中表现优异,但需存储历史样本,增加内存占用并引发隐私问题。提示方法虽无需存储数据,但仍面临任务身份识别不准、共享参数灾难性遗忘等问题。现有提示选择策略存在不准确、缺乏防遗忘机制、难以处理跨任务与任务内差异的缺陷。本文提出WAVE++,受前缀调优与专家混合模型启发,构建任务特异性提示池以增强灵活性并规避边界跨越风险,更有效地捕捉任务内与跨任务变异。通过引入标签描述提供更丰富的全局上下文,提升关系分类能力;提出无训练机制,在推理阶段优化任务预测;同时集成生成模型,将先验知识整合至共享参数中,无需显式存储数据。大量实验表明,WAVE++优于现有提示与重放方法,为持续关系抽取提供了更鲁棒的解决方案。代码已开源。
原文摘要 · Abstract (English)
Memory-based approaches have shown strong performance in Continual Relation Extraction (CRE). However, storing examples from previous tasks increases memory usage and raises privacy concerns. Recently, prompt-based methods have emerged as a promising alternative, as they do not rely on storing past samples. Despite this progress, current prompt-based techniques face several core challenges in CRE, particularly in accurately identifying task identities and mitigating catastrophic forgetting. Existing prompt selection strategies often suffer from inaccuracies, lack robust mechanisms to prevent forgetting in shared parameters, and struggle to handle both cross-task and within-task variations. In this paper, we propose WAVE++, a novel approach inspired by the connection between prefix-tuning and mixture of experts. Specifically, we introduce task-specific prompt pools that enhance flexibility and adaptability across diverse tasks while avoiding boundary-spanning risks; this design more effectively captures both within-task and cross-task variations. To further refine relation classification, we incorporate label descriptions that provide richer, more global context, enabling the model to better distinguish among different relations. We also propose a training-free mechanism to improve task prediction during inference. Moreover, we integrate a generative model to consolidate prior knowledge within the shared parameters, thereby removing the need for explicit data storage. Extensive experiments demonstrate that WAVE++ outperforms state-of-the-art prompt-based and rehearsal-based methods, offering a more robust solution for continual relation extraction. Our code is publicly available at https://github.com/PiDinosauR2804/WAVE-CRE-PLUS-PLUS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。