提出前向回放新方法,提升大模型参数编辑精度
From Backward Spreading to Forward Replay: Revisiting Target Construction in LLM Parameter Editing
- 用前向传播替代传统反向扩散,优化编辑锚点位置
- 相同计算量下,层间目标状态更准确且兼容
- 无需改动原有流程,适配各类大模型编辑方法
大模型参数编辑常依赖在目标层计算理想隐藏状态(锚点),并通过反向传播将该向量分发至前序层以协同编辑。尽管长期使用,其理论基础尚未系统研究。本文首次系统分析其原理,揭示能力边界与失效模式。随后提出新方法:不优化末层目标,而是在首编辑层优化锚点,并通过前向传播获得后续各层精确且一致的目标隐藏状态。该方法保持与现有方法相同的计算复杂度,但生成的逐层目标更准确。其设计简洁,不干扰初始目标状态计算或后续编辑流程,可广泛适配各类大模型参数编辑方法。
原文摘要 · Abstract (English)
LLM parameter editing methods commonly rely on computing an ideal target hidden-state at a target layer (referred as anchor point) and distributing the target vector to multiple preceding layers (commonly known as backward spreading) for cooperative editing. Although widely used for a long time, its underlying basis have not been systematically investigated. In this paper, we first conduct a systematic study of its foundations, which helps clarify its capability boundaries, practical considerations, and potential failure modes. Then, we propose a simple and elegant alternative that replaces backward spreading with forward-propagation. Instead of optimizing the target at the last editing layer, we optimize the anchor point at the first editing layer, and then propagate it forward to obtain accurate and mutually compatible target hidden-states for all subsequent editing layers. This approach achieves the same computational complexity as existing methods while producing more accurate layer-wise targets. Our method is simple, without interfering with either the computation of the initial target hidden state or any other components of the subsequent editing pipeline, and thus constituting a benefit for a wide range of LLM parameter editing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。