揭示记忆型大模型中错误如何跨轮次传播并持久留存
When Errors Become Memories: Causal Pathway Tracing in Multi-Turn Memory-Augmented LLMs

- 用因果模型分析错误在多轮交互中的传播路径
- 发现记忆更新路径比外部反馈导致更持久的错误影响
- 提出修复策略,联合修复可消除98.3%残留错误
长时记忆使大语言模型能在交互间保留并复用信息,但也可能将局部错误转化为持续风险。现有研究多关注记忆系统存储与检索的正确性,缺乏对错误跨响应、记忆状态和未来交互传播机制的理解。本文提出基于结构因果模型(SCM)的框架,将用户提问、模型回复和记忆状态建模为动态因果过程,识别出两个关键入口路径:内部记忆更新与外部问题反馈。通过干预路径构建四种反事实轨迹,量化其下游影响与交互关系。错误影响在四个层面评估:记忆保留、自然回复、定向诊断探测、概率级错误偏好。实验表明,错误影响随交互距离衰减,但记忆更新路径的影响比问题反馈更持久;潜在错误即使从自然回复中消失仍可能残留。传播模式因记忆类别与机制而异。路径引导的修复验证了该分解:问题修复降低27.5%残余错误,记忆修复降低70.2%,联合修复降低98.3%,几乎完全消除传播残留。
原文摘要 · Abstract (English)
Long-term memory enables large language models (LLMs) to preserve and reuse information across interactions, but it can also turn localized errors into persistent risks. Existing work mainly evaluates whether memory systems store and retrieve information correctly, leaving limited understanding of how errors propagate across responses, memory states, and future interactions. We propose a structural causal model (SCM)-based framework for cross-turn error propagation in memory-augmented LLMs. We model user questions, model responses, and memory states as a dynamic causal process, and identify two entry pathways: internal memory updating and external question feedback. By intervening on these pathways, we construct four counterfactual trajectories and quantify their downstream effects and interaction. Error influence is evaluated at four levels: memory retention, natural responses, targeted diagnostic probing, and probability-level error preference. Experiments show that error influence generally decays with interaction distance, while the memory-update pathway contributes more persistent effects than question feedback; latent errors may remain even after disappearing from natural responses. Propagation patterns also vary across memory categories and memory mechanisms. Pathway-guided restoration further validates this decomposition: Question Repair reduces residual error by 27.5%, Memory Repair by 70.2%, and Joint Repair by 98.3%, nearly eliminating residual propagation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。