同时修改模型底层信息和高层概率,让大模型更准地更新知识。
Joint Knowledge Editing for Information Enrichment and Probability Promotion
- 通过对比探查定位编辑关键阶段:底层信息增强与高层概率提升。
- 在多个模型上验证,可同时高效更新数千条事实知识。
- 适合需要精准知识更新的场景,如智能客服、学术问答系统。
大语言模型中的知识需及时更新以反映现实动态。现有编辑方法多聚焦低层,因探测显示答案信息在低层被丰富。然而,这些探测仅揭示原答案的关键回忆阶段,而编辑目标是修正模型对目标答案的预测,存在不一致。为此,我们提出基于对比的探测方法,识别出两个关键阶段:底层的信息增强与高层的概率提升。据此,我们设计了联合知识编辑方法 JEEP,同步修改低层与高层,以调整这两个关键阶段。为避免双重修改带来的干扰与遗忘,JEEP 使各区域更新目标一致且互补。我们在 GPT-J(6B)和 LLaMA(7B)上测试,对数千条事实进行编辑,涵盖真实与反事实知识。所有场景下性能最优,验证了探测发现与方法设计的有效性。代码与数据已公开于 https://github.com/Eric8932/JEEP。
原文摘要 · Abstract (English)
Knowledge stored in large language models requires timely updates to reflect the dynamic nature of real-world information. To update the knowledge, most knowledge editing methods focus on the low layers, since recent probes into the knowledge recall process reveal that the answer information is enriched in low layers. However, these probes only and could only reveal critical recall stages for the original answers, while the goal of editing is to rectify model's prediction for the target answers. This inconsistency indicates that both the probe approaches and the associated editing methods are deficient. To mitigate the inconsistency and identify critical editing regions, we propose a contrast-based probe approach, and locate two crucial stages where the model behavior diverges between the original and target answers: Information Enrichment in low layers and Probability Promotion in high layers. Building upon the insights, we develop the Joint knowledge Editing for information Enrichment and probability Promotion (JEEP) method, which jointly edits both the low and high layers to modify the two critical recall stages. Considering the mutual interference and growing forgetting due to dual modifications, JEEP is designed to ensure that updates to distinct regions share the same objectives and are complementary. We rigorously evaluate JEEP by editing up to thousands of facts on various models, i.e., GPT-J (6B) and LLaMA (7B), and addressing diverse editing objectives, i.e., adding factual and counterfactual knowledge. In all tested scenarios, JEEP achieves best performances, validating the effectiveness of the revealings of our probe approach and the designs of our editing method. Our code and data are available at https://github.com/Eric8932/JEEP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。