让大模型持续纠错时保持能力,不被新参数破坏。
QueueEDIT: Structural Self-Correction for Sequential Model Editing in LLMs
- 用知识敏感神经元定位法精准找到需改参数。
- 队列动态管理旧参数,避免影响模型通用能力。
- 适合需要长期更新知识的大模型应用者。
大语言模型虽表现优异,但仍存在幻觉问题。模型编辑被提出用于修正事实错误,但连续编辑(SME)会因引入新参数而损害模型通用能力。本文提出基于队列的自校正框架QueueEDIT,通过结构化映射损失将三元组知识映射至Transformer层中的知识敏感神经元,将每条知识的参数存入队列并动态对齐历史编辑。每次编辑时,筛选与当前参数最相关的队列参数判断是否需重对齐,无关参数冻结,仅更新队列头部参数以保护通用能力。实验表明,该框架在多种SME设置下显著优于强基线,且在单次编辑任务中保持竞争力,整个编辑过程中模型仍保有高水平通用NLP能力。
原文摘要 · Abstract (English)
Recently, large language models (LLMs) have demonstrated impressive results but still suffer from hallucinations. Model editing has been proposed to correct factual inaccuracies in LLMs. A challenging case is sequential model editing (SME), which aims to rectify errors continuously rather than treating them as a one-time task. During SME, the general capabilities of LLMs can be negatively affected due to the introduction of new parameters. In this paper, we propose a queue-based self-correction framework (QueueEDIT) that not only enhances SME performance by addressing long-sequence dependency but also mitigates the impact of parameter bias on the general capabilities of LLMs. Specifically, we first introduce a structural mapping editing loss to map the triplets to the knowledge-sensitive neurons within the Transformer layers of LLMs. We then store the located parameters for each piece of edited knowledge in a queue and dynamically align previously edited parameters. In each edit, we select queue parameters most relevant to the currently located parameters to determine whether previous knowledge needs realignment. Irrelevant parameters in the queue are frozen, and we update the parameters at the queue head to the LLM to ensure they do not harm general abilities. Experiments show that our framework significantly outperforms strong baselines across various SME settings and maintains competitiveness in single-turn editing. The resulting LLMs also preserve high capabilities in general NLP tasks throughout the SME process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。