arXiv:2512.04545cs.CL2025-12

让大模型像人一样持续学习新知识,还能不忘记旧内容。

EvoEdit: Lifelong Free-Text Knowledge Editing through Latent Perturbation Augmentation and Knowledge-driven Parameter Fusion

  • 用自然语言编辑知识,通过潜空间扰动增强新知识注入
  • 在16,835条自由文本编辑请求上表现优于现有方法
  • 适合需要持续更新知识的AI系统研发者

大语言模型部署后更新过时知识仍是重大挑战。现有方法依赖结构化三元组,与模型预训练的自由文本特性不符,且通常仅支持单次更新,缺乏对连续或长期编辑的研究。为此,我们提出新任务 Lifelong Free-text Knowledge Editing (LF-Edit),支持以自然语言形式持续更新知识。为推动该任务研究,我们构建了包含16,835条自由文本编辑请求的大规模基准MRLF-Bench,设计涵盖记忆、理解、受限理解与推理四个层次的多层级评估框架。针对知识融合与遗忘难题,提出EvoEdit方法,通过潜空间扰动增强与知识驱动参数融合实现高效编辑。实验表明,EvoEdit在新任务上显著优于现有方法。

原文摘要 · Abstract (English)

Adjusting the outdated knowledge of large language models (LLMs) after deployment remains a major challenge. This difficulty has spurred the development of knowledge editing, which seeks to accurately and efficiently modify a model's internal (parametric) knowledge without retraining it from scratch. However, existing methods suffer from two limitations. First, they depend on structured triplets that are misaligned with the free-text nature of LLM pretraining and fail to capture the nuanced relationships among facts. Second, they typically support one-time knowledge updates, with relatively limited research on the problem of sequential or lifelong editing. To address these gaps, we propose a new task, Lifelong Free-text Knowledge Editing (LF-Edit), which enables models to incorporate updates expressed in natural language and supports continual editing over time. Despite its promise, LF-Edit faces the dual challenge of integrating new knowledge while mitigating the forgetting of prior information. To foster research on this new task, we construct a large-scale benchmark, Multi-Rank Lifelong Free-text Editing Benchmark (MRLF-Bench), containing 16,835 free-text edit requests. We further design a cognitively inspired multi-rank evaluation framework encompassing four levels: memorization, understanding, constrained comprehension, and reasoning. To tackle the challenges inherent in LF-Edit, we introduce a novel approach named EvoEdit that enhances knowledge injection through Latent Perturbation Augmentation and preserves prior information via Knowledge-driven Parameter Fusion. Experimental results demonstrate that EvoEdit substantially outperforms existing knowledge editing methods on the proposed LF-Edit task.

知识编辑持续学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。