arXiv:2601.15686cs.LG2026-01被引 1

提出在线递归编辑方法,实现大模型长期稳定更新而不丢失原有能力。

Beyond Hard Writes and Rigid Preservation: Soft Recursive Least-Squares for Lifelong LLM Editing

  • 采用软约束的递归最小二乘法,实时融合新知识并控制参数偏离。
  • 支持10000次连续编辑,保持95%以上编辑成功率和原始模型性能。
  • 适合需要持续更新知识的大模型应用,如智能助手、知识库系统。

模型编辑在不重新训练的前提下,更新预训练大模型的新事实或规则,同时保持无关行为不变。在真实部署中,编辑以连续流形式到来,引发可塑性与稳定性之间的矛盾:反复进行定位-编辑的硬写操作会随时间积累干扰,而僵化的保护约束仅能维护显式指定方向,导致过往编辑或未约束行为发生漂移。我们提出RLSEdit,一种用于长期连续编辑的递归最小二乘编辑器。该方法将编辑建模为带有软约束的在线二次优化问题,最小化累积键值拟合目标,并引入两项正则项,分别控制与预训练权重及指定锚定映射的偏差。该目标可通过基于Woodbury公式的高效在线递推求解,每次编辑开销独立于历史长度,仅与当前编辑规模相关。我们进一步提供了偏差界及多编辑场景下的渐近保真-保留权衡特性。在CounterFact和ZsRE数据集上,跨多个模型家族的实验表明,该方法可稳定扩展至10,000次编辑,在编辑成功率和整体稳定性上均优于强基线,同时保留早期编辑结果,并在GLUE及未见推理/代码基准上维持通用能力。

原文摘要 · Abstract (English)

Model editing updates a pre-trained LLM with new facts or rules without retraining while preserving unrelated behavior. In real deployment, edits arrive as long streams, creating a plasticity-stability dilemma: repeated locate-then-edit "hard writes" can accumulate interference over time, while rigid preservation constraints may protect only explicitly constrained directions, allowing past edits or unconstrained behaviors to deviate. We propose RLSEdit, a recursive least-squares editor for long sequential editing. RLSEdit formulates editing as an online quadratic optimization with soft constraints, minimizing a cumulative key-value fitting objective together with two regularizers that control deviation from the pre-trained weights and from a designated anchor mapping. This objective admits an efficient Woodbury-based online recursion, with per-edit cost independent of history length and scaling only with the current edit size. We further provide deviation bounds and an asymptotic characterization of the adherence-preservation trade-off in the many-edits regime. Experiments on CounterFact and ZsRE across multiple model families show stable scaling to 10K edits, outperforming strong baselines in both edit success and holistic stability, while retaining early edits and preserving general capabilities on GLUE and held-out reasoning/code benchmarks.

模型编辑持续学习大模型在线优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。