arXiv:2509.22072cs.CL2025-09中稿 · ICLR被引 8

纠正微调在模型编辑中的误区,实现百万级精准修改。

Fine-tuning Done Right in Model Editing

  • 改用广度优先的批量训练,避免单样本过度优化
  • 支持10万次编辑且保持720亿参数模型能力不下降
  • 适合需要大规模、高精度模型修改的研究与应用

微调长期以来被视为模型编辑无效的方法。本文指出,问题并非源于微调本身,而是其被应用于单次深度优先的编辑流程,导致每条数据独立优化至收敛,引发编辑间干扰。通过控制实验发现,恢复标准的广度优先(即基于轮次)批量优化策略,可显著提升微调在编辑任务中的表现。此外,现有方法中调参位置不佳也制约效果。通过系统分析调参位置,提出基于恢复微调框架的局部调参方法LocFT-BF。大量实验证明,该方法在多种大模型和数据集上均大幅领先当前最优水平。值得注意的是,它是首个在不牺牲通用能力的前提下,支持10万次编辑及720亿参数模型的方案,性能超越此前实践10倍。本研究澄清长期误解,将微调从被低估的基线提升为模型编辑的主流方法,为后续研究奠定坚实基础。

原文摘要 · Abstract (English)

Fine-tuning, a foundational method for adapting large language models, has long been considered ineffective for model editing. Here, we challenge this belief, arguing that the reported failure arises not from the inherent limitation of fine-tuning itself, but from adapting it to the sequential nature of the editing task, a single-pass depth-first pipeline that optimizes each sample to convergence before moving on. While intuitive, this depth-first pipeline coupled with sample-wise updating over-optimizes each edit and induces interference across edits. Our controlled experiments reveal that simply restoring fine-tuning to the standard breadth-first (i.e., epoch-based) pipeline with mini-batch optimization substantially improves its effectiveness for model editing. Moreover, fine-tuning in editing also suffers from suboptimal tuning parameter locations inherited from prior methods. Through systematic analysis of tuning locations, we derive LocFT-BF, a simple and effective localized editing method built on the restored fine-tuning framework. Extensive experiments across diverse LLMs and datasets demonstrate that LocFT-BF outperforms state-of-the-art methods by large margins. Notably, to our knowledge, it is the first to sustain 100K edits and 72B-parameter models,10 x beyond prior practice, without sacrificing general capabilities. By clarifying a long-standing misconception and introducing a principled localized tuning strategy, we advance fine-tuning from an underestimated baseline to a leading method for model editing, establishing a solid foundation for future research.

模型编辑微调优化大模型局部调参

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。