提出智能路由机制,让模型按需调用记忆,提升科学推理准确性。
Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning

- 基于输入特征动态决定是否启用记忆,避免无效干扰。
- 在生物与化学推理任务中,显著减少记忆带来的错误回归。
- 适合需要精准知识调用的科研类AI系统开发者参考。
科学推理要求语言模型可靠地检索专业知识并融入多步计算。条件记忆提供了显式的查询路径,补充密集神经表示,但其有效性依赖于输入和计算过程:检索信息可能修复缺失的科学关联,也可能引入干扰性捷径或破坏原本正确的推理。本文系统研究了条件记忆在何时、何地以及多大程度上应参与科学推理。通过刻画知识边界并控制记忆增强型知识回路节点的干预,我们提出一种知识边界感知路由器,利用生成前可用的任务特定输入代理,决定是否激活记忆、哪些层阶段节点接收记忆信号,以及信号强度。在涵盖两种主干架构和六种任务类型的生物与化学推理基准上的实验表明,记忆效果在不同输入、任务和注入位置间差异显著。相比静态路由和激活率匹配的随机路由,本方法更一致地保留有益的记忆贡献,同时抑制记忆引发的退化,确立了选择性记忆分配是可靠科学推理的重要原则。
原文摘要 · Abstract (English)
Scientific reasoning requires language models to retrieve specialized knowledge and incorporate it reliably into multi-step computation. Conditional memory provides an explicit lookup pathway that complements dense neural representations, but its usefulness is inherently input- and computation-dependent: retrieved information may repair missing scientific associations, yet it may also introduce distracting shortcuts or interfere with reasoning that the base model can already perform correctly. In this work, we systematically investigate when, where, and to what extent conditional memory should participate in scientific reasoning. We characterize the scientific knowledge boundary and controlled interventions on memory-enabled knowledge-circuit nodes. Based on these analyses, we propose a Knowledge Boundary-Aware Router that uses task-specific input proxies available before generation to determine whether memory is activated, which layer-stage nodes receive memory signals, and how strongly these signals contribute. Experiments on biological and chemical reasoning benchmarks, covering two backbone families and six task types, show that memory effects vary substantially across inputs, tasks, and injection locations. Compared with static and activation-rate-matched random routing, our approach more consistently preserves beneficial memory contributions while suppressing memory-induced regressions, establishing selective memory allocation as an important principle for reliable scientific reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。