arXiv:2604.19089cs.AI2026-04ACL被引 1

轻量级知识编辑框架,实现高效持续更新且不遗忘旧知识。

Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression

论文配图:Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression
图 1 · 摘自论文原文
  • 通过选择性检索与概率抑制策略,精准修改特定知识。
  • 在三个基准测试中均优于现有方法,保持高编辑稳定性。
  • 训练成本低,适合快速适配不同数据集的长期使用。

大型语言模型需频繁更新知识以反映事实变化并减少幻觉。为满足这一需求,持续知识编辑成为无需重训练即可修改特定知识的方案。现有参数编辑方法在连续编辑中易受灾难性遗忘影响;而基于检索的方法虽缓解此问题,但因训练成本高,适用范围受限。为此,我们提出 LightEdit 框架:首先从检索信息中筛选相关知识以有效响应查询,再引入解码策略抑制模型原有知识概率,从而实现基于选定信息的高效编辑。在 ZSRE、Counterfact 与 RIPE 基准上的大量实验表明,LightEdit 在持续编辑场景下性能超越现有方法。此外,通过极低训练成本实现低成本可扩展性,使其易于适配多种数据集。

原文摘要 · Abstract (English)

Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of knowledge without retraining the entire model. Existing parameter editing methods struggle with stability during sequential edits due to catastrophic forgetting. While retrieval-based approaches are proposed to alleviate this issue, their applicability remains limited across various datasets because of high training costs. To address these limitations and enhance scalability in lifelong settings, we propose LightEdit. Our framework first selects relevant knowledge from retrieved information to modify the query effectively. It then incorporates a decoding strategy to suppress the model's original knowledge probabilities, thereby enabling efficient edits based on the selected information. Extensive experiments on ZSRE, Counterfact, and RIPE benchmarks demonstrate that LightEdit outperforms existing lifelong knowledge editing methods. Furthermore, by minimizing training costs, LightEdit achieves cost-effective scalability, enabling easy adaptation to various datasets.

知识编辑持续学习轻量化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。