arXiv:2608.27924cs.CL2026-08

探究智能体记忆如何可靠处理无法回答的问题

What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?

论文配图:What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?
图 1 · 摘自论文原文
  • 在统一框架下测试四种记忆方法对不可答问题的处理效果
  • 记忆提升效果有限且易受数据分布变化影响,跨模型复用比跨数据集更可行
  • 程序化与规则型记忆最可靠,结合行为信号能更好支持判断

可靠处理不可答问题(UAQ)对基于大模型的智能体可信性至关重要。尽管记忆广泛应用于智能体系统,其在可靠处理不可答问题中的作用仍不明确。本文在统一的智能体检索增强生成(RAG)框架下,评估了四种代表性记忆方法在三个与不可答问题相关的数据集和两个基础模型上的表现。结果发现,记忆在某些场景下可提升性能,但这种增益具有选择性而非普遍性,且在数据集迁移时仍脆弱。有趣的是,跨模型记忆复用通常比跨数据集迁移更可行,表明答案可答性模式的变化比基础模型本身更具挑战性。进一步发现,通过决策引导保留的增益强于通过轨迹塑造的方式,且记忆有效性高度依赖表示形式。特别是,程序化与规则型记忆对不可答问题处理最为可靠,而当程序化指导与互补行为信号结合时,记忆组合效果最佳。总体而言,可靠不可答问题处理的记忆,更多取决于传递可复用的行为指引,而非存储更多经验。

原文摘要 · Abstract (English)

Reliable handling of unanswerable questions (UAQs) is critical for trustworthy LLM-based agents. Although memory is widely used in agent systems, its role in reliable UAQ handling remains unclear. We present a systematic study of agent memory for UAQ handling under a unified agentic RAG framework, evaluating four representative memory methods across three UAQ-related datasets and two base models. We find that memory can improve UAQ performance in some settings, but such gains are selective rather than universal and remain fragile under dataset shift. Interestingly, cross-model memory reuse is often more feasible than cross-dataset transfer, suggesting that shifts in answerability patterns pose a greater challenge to memory reuse than changes in the base model itself. We further find that UAQ gains are more strongly preserved through decision guidance than through trajectory shaping, and that memory effectiveness depends strongly on representation. In particular, procedural and rule-based memories often provide the most reliable support for UAQ handling, while memory composition is most effective when procedural guidance is combined with complementary behavioral signals. Overall, our findings suggest that reliable UAQ memory depends less on storing larger amounts of experience and more on preserving transferable behavioral guidance.

智能体记忆机制不可答问题RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。