arXiv:2608.01679cs.AI2026-08被引 3

记忆固化会丢失信息授权边界,导致模型误用权限。

When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary

  • 通过控制实验对比不同来源权限,检测记忆固化中的授权崩溃。
  • 48/49配置中出现授权崩溃,未加约束的记忆导致50.3%越权操作。
  • 自动标记授权信息可将越权率从16.9%降至0.0%,适合安全型代理研究。

持续记忆使大模型智能体能跨任务适应,通过整合异构交互历史为可复用的事实、偏好、观察与规则。但记忆固化也隐含授权边界:决定存储信息能否被当作用户事实、可信观察或正式指令使用。我们发现授权崩溃现象——记忆固化保留了陈述内容,却丢失了原始来源的使用限制,使存储记忆获得超出其授权范围的权威性。为此提出AuthMem-Bench,一个受控配对基准,固定核心主张与下游任务,仅变化来源权限。该基准评估写入时的授权崩溃、下游授权错误及自动授权保留能力。在基于七种主流智能体记忆系统和七种LLM主干的49个配置中,48个出现授权崩溃。在受控动作评估中,无授权元数据的记忆导致平均越权行为率达50.3%;而在端到端评估中,自动预测并持久化授权标签可将越权率从16.9%降至0.0%,且良性任务成功率基本不变。结果表明,记忆驱动的适应不仅需保留知识本身,更须保留其可复用的授权条件。

原文摘要 · Abstract (English)

Persistent memory allows (self-evolving) LLM agents to adapt across tasks by consolidating heterogeneous interaction histories into reusable facts, preferences, observations, and rules. Yet consolidation also imposes an implicit authorization boundary: it determines whether stored information may later be consumed as a user fact, an attested observation, or a standing instruction. We identify authority collapse, in which consolidation preserves a claim while erasing the source constraints governing its authorized use, causing the stored memory to imply greater authority than its source permits. We introduce AuthMem-Bench, a controlled paired benchmark that holds the focal claim and downstream task fixed while varying only source authority. It evaluates write-time collapse, downstream authorization errors, and automatic authority preservation. Across seven consolidators based on widely used agent-memory systems and seven LLM backbones, we observe authority collapse in 48 of 49 evaluated configurations. In a controlled action-grounded evaluation, collapsed memories without authority metadata yield a mean unauthorized-action rate of 50.3%. In an end-to-end evaluation, automatically predicted and persisted authority labels reduce the observed unauthorized-action rate from 16.9% to 0.0%, while benign task success remains essentially unchanged. These findings show that memory-driven adaptation must preserve not only what was learned, but also the authority under which it may be reused.

大模型安全记忆机制授权控制智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。