arXiv:2410.23843cs.AIcs.CL2024-10NeurIPS被引 13

提出新方法解决编辑模型性能下降问题,提升多轮有效编辑能力。

Reasons and Solutions for the Decline in Model Performance after Editing

  • 构建多问题数据集,发现编辑目标多样性与序列长度影响性能。
  • 发现编辑层L1范数与准确率强相关,是性能瓶颈关键因素。
  • 提出D4S方法降低层范数,支持多次有效编辑且减少模型损伤。

知识编辑技术因低成本更新大模型中错误或过时知识而受到广泛关注。然而,近期研究发现编辑后模型常出现不同程度的性能退化,其原因及解决方案尚未明确。为探究编辑模型性能下降的原因并优化编辑方法,本文从数据与模型双角度展开研究。首先,构建多问题数据集(MQD),实验表明编辑目标多样性与序列长度对模型性能影响显著。其次,从模型视角分析发现,编辑层的L1范数与编辑准确率存在强相关性,是导致性能瓶颈的重要因素。为此,本文提出一种序列丢弃方法(Dump for Sequence, D4S),通过降低编辑层的L1范数,成功突破原有性能瓶颈,实现多次有效编辑的同时最小化模型损伤。代码已公开于https://github.com/nlpkeg/D4S。

原文摘要 · Abstract (English)

Knowledge editing technology has received widespread attention for low-cost updates of incorrect or outdated knowledge in large-scale language models. However, recent research has found that edited models often exhibit varying degrees of performance degradation. The reasons behind this phenomenon and potential solutions have not yet been provided. In order to investigate the reasons for the performance decline of the edited model and optimize the editing method, this work explores the underlying reasons from both data and model perspectives. Specifically, 1) from a data perspective, to clarify the impact of data on the performance of editing models, this paper first constructs a Multi-Question Dataset (MQD) to evaluate the impact of different types of editing data on model performance. The performance of the editing model is mainly affected by the diversity of editing targets and sequence length, as determined through experiments. 2) From a model perspective, this article explores the factors that affect the performance of editing models. The results indicate a strong correlation between the L1-norm of the editing model layer and the editing accuracy, and clarify that this is an important factor leading to the bottleneck of editing performance. Finally, in order to improve the performance of the editing model, this paper further proposes a Dump for Sequence (D4S) method, which successfully overcomes the previous editing bottleneck by reducing the L1-norm of the editing layer, allowing users to perform multiple effective edits and minimizing model damage. Our code is available at https://github.com/nlpkeg/D4S.

知识编辑模型优化性能退化L1正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。