arXiv:2608.15703cs.AI2026-08

通过分层隔离信息,让大模型在长任务中更专注、不遗忘。

HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation

论文配图:HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation
图 1 · 摘自论文原文
  • 将上下文按功能分层,分离规划与执行信息
  • 在DeepSeek-V4上任务通过率分别达66.7%和61.3%
  • 适合需要长期推理的复杂任务场景

大型语言模型(LLM)代理在处理复杂长周期任务时表现不佳,因上下文随交互累积而日益杂乱。执行轨迹和中间输出占据主导,导致高阶规划信息难以保留与利用。现有方法多采用单一扁平上下文的压缩或检索,未能清晰区分不同类型的上下文信息,常引发推理质量下降。为此,我们提出HyMem,一种分层框架,显式将代理上下文划分为不同功能层级。HyMem按功能组织上下文,分离高层规划与执行、复杂分析。其隔离推理模块处理复杂子任务时不将中间推理痕迹写入持久规划上下文,记忆管理模块则通过结构化摘要在上下文刷新时保留任务进展。该设计减少冗余信息积累,保留关键任务信息,支持有限上下文窗口内的连贯长周期推理。在GAIA和Browsecomp-plus数据集上的实验表明,使用DeepSeek-V4时,HyMem的Pass@1平均得分分别为66.7%和61.3%,优于最强基线6.1和4.7个百分点。进一步分析显示,HyMem有效控制了推理上下文增长,使模型在复杂长周期任务中保持专注与准确。

原文摘要 · Abstract (English)

Large language model (LLM) agents often perform poorly on complex, long-horizon tasks because their context becomes increasingly cluttered over time. As interactions accumulate, detailed execution traces and intermediate outputs dominate the context, making it difficult for the model to retain and use high-level planning information. Most existing methods address this issue through compression or retrieval applied to a single, flat context, which does not clearly separate different types of context information and often leads to degraded reasoning. To address this challenge, we propose HyMem, a hierarchical framework that explicitly separates the agent's context into distinct functional layers. HyMem organizes context by function to separate high-level planning from execution and complex analysis. Its isolated reasoning module handles complex subtasks without adding intermediate reasoning traces to the persistent planning context, while its memory management module preserves task progress across context refreshes through structured summaries. These components reduce redundant context accumulation, retain task-critical information, and support coherent long-horizon reasoning within a limited context window. Experiments on GAIA and Browsecomp-plus show that, with DeepSeek-V4, HyMem achieves average Pass@1 scores of 66.7% and 61.3%, outperforming the strongest baseline by 6.1 and 4.7 percentage points, respectively. Further analysis indicates that HyMem effectively controls the growth of the reasoning context, allowing the model to maintain focus and accuracy across complex, long-horizon tasks.

大模型代理长周期任务上下文管理分层架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。