让大模型同时记住过去和现在的答案,用一个向量搞定时间敏感的修改。
PRISM Edit: One Vector for All Temporal Answers

- 用单个可变表征结合模型内部时间调制路径,实现无需改架构的时间事实更新。
- 在LLaMA-3上提升23.3%时间一致性与33.7%当前相对时间得分。
- 适合需要精准处理历史与时效信息的应用,如知识库维护与动态问答系统。
模型编辑可在不重新训练的情况下使大语言模型保持更新,但时间性事实暴露了现有定位-编辑范式的局限:更新未必是替换。当事实变化时,新答案应为当前正确,而旧答案在历史语境中仍可能成立。基于此洞察,我们通过因果追踪发现,大模型内部存在两阶段计算机制:早期MLP层提取无时间依赖的主题表征,后期层则根据时间上下文调节该表征以生成时间正确的答案。受此启发,我们提出PRISM Edit,通过优化单一多义表征在不同时间上下文中的表现,并利用模型固有的调制路径实现时间正确预测,无需任何架构修改。我们在新提出的TimeConflict时间编辑基准及增强版CounterFact上进行评估,结果表明,PRISM Edit在多个核心指标上超越最佳基线,尤其在LLaMA-3上实现23.3%的时空一致性(TC)与33.7%的当前相对时间得分(CRS)提升,且速度提升超过2倍。代码与数据已公开于https://github.com/CheerCHuang/PRISM-Edit。
原文摘要 · Abstract (English)
Model editing keeps large language models (LLMs) up to date without retraining, but temporal facts expose a limitation of the prevailing locate-and-edit paradigm: an update is not always a replacement. When a fact changes, the new answer should become current while the old answer may remain correct in historical time contexts. Building on this insight, we use causal tracing to show that LLMs already support this distinction via a two-stage internal computation: early MLP layers retrieve a time-agnostic subject representation, and later layers modulate it with temporal context to yield the time-correct answer. Motivated by this finding, we introduce PRISM Edit, which optimizes a single polysemous representation across temporal contexts and leverages the model's inherent modulation pathway to route it to temporally correct predictions without requiring any architectural modification. We evaluate on TimeConflict, a newly introduced temporal editing benchmark, and on temporally augmented CounterFact. PRISM Edit improves multiple core metrics over the best baseline, most notably +23.3 Temporal Consistency (TC) and +33.7 Current Relative-time Score (CRS) on LLaMA-3, while being more than 2x faster. Code and data are publicly available at https://github.com/CheerCHuang/PRISM-Edit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。