arXiv:2603.12677cs.CLcs.AI2026-03

提出新框架MetaKE,让知识编辑更准且更易改。

MetaKE: Meta-Learning for Knowledge Editing Toward a Better Accuracy-Editability Trade-off

  • 用双层优化统一编辑前后阶段,避免信息断连
  • 在多个数据集上准确率提升1.8%-4.2%,编辑成功率更高
  • 适合需要高精度与强可编辑性的知识系统应用

现有定位-编辑型知识编辑方法通常将编辑分为两个阶段:上游目标表征优化与下游约束参数优化。两阶段间优化脱节:上游使用统一正则化,未观察下游对计划残差的实现情况,难以精细平衡准确性与可编辑性。由于下游实现依赖具体请求和约束,统一正则化可能导致高关联请求过度压缩,造成编辑不足;同时可能对低关联请求正则不足,导致计划残差过大,降低下游可编辑性。为此,我们提出MetaKE(面向知识编辑的元学习),将上下游阶段统一为双层优化问题。内层优化目标表征的参数更新,外层利用下游约束反馈优化表征,实现更好的语义准确性-可编辑性权衡。为避免多层反向传播的开销,引入结构梯度代理近似并传播该反馈。大量实验表明,MetaKE显著优于强基线,为知识编辑提供了新视角。

原文摘要 · Abstract (English)

Existing locate-then-edit Knowledge Editing (KE) methods typically decompose editing into two stages: upstream target representation optimization and downstream constrained parameter optimization. The optimization across the two stages is disconnected: upstream applies uniform regularization without observing downstream realization of the planned residual, hindering a refined accuracy-editability trade-off. Since this realization is request-specific and depends on downstream constraints, uniform regularization can over-shrink high-association requests, causing insufficient editing, while it can under-regularize low-association requests, producing over-large planned residuals that reduce downstream editability. To bridge this disconnect, we propose MetaKE (Meta-learning for Knowledge Editing), a new framework that unifies upstream and downstream stages into a bi-level optimization problem. The inner level optimizes parameter updates for the target representation, while the outer level optimizes representation using feedback from downstream constraints, achieving a better semantic accuracy-editability trade-off. To avoid costly multi-layer backpropagation, we introduce a Structural Gradient Proxy to approximate and propagate this feedback. Extensive experiments show that MetaKE outperforms strong baselines, offering a new perspective on KE.

知识编辑元学习双层优化模型可编辑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。