arXiv:2606.14668cs.LG2026-06

通过智能路由选择编辑时机,实现知识更新与原有行为的精准平衡。

When to Write and When to Suppress: Route-Specialized Dual Adapters for Memory-Assisted Knowledge Editing

论文配图:When to Write and When to Suppress: Route-Specialized Dual Adapters for Memory-Assisted Knowledge Editing
图 1 · 摘自论文原文
  • 设计双适配器路由机制,按需决定是否应用知识编辑。
  • 在三个基准上达到最高准确率,最高达99.22%的偏好准确性。
  • 适合需要高精度知识更新且不破坏原有能力的研究者使用。

知识编辑系统需更新特定事实,同时保留相关但无关的行为。本文研究在记忆辅助设置下的该问题,即推理时检索编辑记忆,并通过参数高效适配器修正模型的对象偏好。核心挑战不仅是如何写入编辑,还包括何时抑制编辑。提出RRDA——一种路径专用的双适配器编辑器:相关性路由器首先判断提示是否应接收编辑记忆。经路由的提示使用训练为偏好新对象的编辑适配器;未路由的非直接提示则使用独立的局部性适配器,以保持或恢复原对象偏好。在三个1,000条案例协议(CounterFact、ZsRE、MQuAKE-CF)上评估,采用相同记忆策略和两个7B/8B基模型。在Llama-3.1-8B-Instruct上,RRDA在所有三基准中均取得最佳概率偏好准确率:CounterFact为0.8180,ZsRE为0.8946,MQuAKE-CF为0.9922。相同趋势也见于Qwen3-8B。路由器消融实验表明,不同数据集的相关记忆边界不同:词汇神经路由器在CounterFact上最安全,而BGE嵌入路由在ZsRE和MQuAKE-CF上表现更优。记忆、组件和模块消融显示,显式记忆带来最大编辑收益,而路径专用适配器提升最终可靠性与局部性之间的平衡,而非单纯增加LoRA容量。

原文摘要 · Abstract (English)

Knowledge editing systems must update selected facts while preserving nearby but irrelevant behavior. This paper studies this problem in a memory-assisted setting where an edit memory is retrieved at inference time and a parameter-efficient adapter corrects the model's object preference. We argue that the central design question is not only how to write an edit, but also when to suppress it. We introduce RRDA, a route-specialized dual-adapter editor. A relevance router first decides whether a prompt should receive an edit memory. Routed prompts use an edit adapter trained to prefer the new object over the original object; unrouted non-direct prompts use a separate locality adapter trained to preserve or restore the original-object preference. We evaluate RRDA on three 1,000-case protocols, CounterFact, ZsRE, and MQuAKE-CF, under the same memory protocol and two 7B/8B base models. On Llama-3.1-8B-Instruct, RRDA obtains the best overall probability-preference accuracy on all three benchmarks: 0.8180 on CounterFact, 0.8946 on ZsRE, and 0.9922 on MQuAKE-CF. The same trend holds on Qwen3-8B. Router ablations show that the relevant memory boundary differs across datasets: a lexical neural router is safest on CounterFact, while BGE embedding routing is better on ZsRE and MQuAKE-CF. Memory, component, and module ablations show that explicit memory supplies the largest edit gain, while route-specialized adapters improve the final reliability-locality balance rather than simply increasing LoRA capacity.

知识编辑双适配器路由机制内存辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。