arXiv:2606.28349cs.IRcs.AI2026-06

HMARS通过分层多智能体系统更完整地捕捉长文本中的推理证据。

HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning

论文配图:HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning
图 1 · 摘自论文原文
  • 分层设计:底层代理管理局部记忆,中层协调上下文,顶层执行推理。
  • 在长文档与多轮对话任务中表现最优,证据覆盖更全面。
  • 适合需要深度长程推理的复杂问答场景,如法律、医疗分析。

长上下文推理要求模型从文档、对话和交互历史中检索并整合分散的证据。标准检索增强生成将问题简化为前K个片段的检索,但这种被动访问可能在推理前丢弃相关证据,尤其当相关性依赖于全局上下文时。我们提出HMARS——一种层次化多智能体记忆系统,将长上下文视为受控记忆而非扁平检索库。子代理维护对有限记忆区域的可落地访问,中层代理管理区域上下文并提供查询特定协调,前端模型基于检索到的证据页进行最终推理。为验证该思路,我们构建了两个诊断基准,分别关注证据广度与上下文依赖的相关性。在长文档和多轮记忆任务中,HMARS在检索、重排序、全上下文、图结构及代理式长上下文基线中表现最佳。证据覆盖率分析进一步表明,其优势源于更完整地检索所需支持证据,而非仅改变最终答案提示。

原文摘要 · Abstract (English)

Long-context reasoning requires models to access, retrieve, and integrate evidence scattered across documents, dialogues, and accumulated interaction histories. Standard retrieval-augmented generation reduces this problem to top-$K$ chunk retrieval, but such passive access can discard relevant evidence before reasoning begins, especially when relevance depends on broader context. We propose HMARS, a hierarchical multi-agent memory system that treats long contexts as managed memory rather than a flat retrieval corpus. Sub-agents maintain grounded access to bounded memory regions, mid-agents manage regional context and provide query-specific coordination, and a frontier model performs final reasoning over retrieved evidence pages. To evaluate this view, we construct two diagnostic benchmarks targeting evidence breadth and context-dependent relevance. Across long-document and multi-turn memory tasks, HMARS achieves the best overall performance against retrieval, reranking, full-context, graph-based, and agentic long-context baselines. Evidence coverage analysis further shows that its gains come from retrieving the required supporting evidence more completely, rather than merely changing the final answer prompt.

长上下文多智能体记忆系统推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。