arXiv:2607.20064cs.AI2026-07被引 2

用程序化记忆让大模型长期推理更高效,少用4倍以上tokens就超了顶尖方法。

PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning

  • 构建结构化交互日志,用编码代理检索历史信息。
  • 在ARC-AGI-3上比基础编码代理平均高18.0个百分点,最高达76.1%通过率。
  • 适合需要长期探索与决策的智能体任务,如复杂游戏或持续学习场景。

长时程任务需要持续感知、推理与探索,是大语言模型(LLM)智能体的长期挑战。这一差距体现在其在连续学习基准测试如ARC-AGI-3上的表现受限,尤其在未微调情况下。现有智能体框架各有应对长序列观察的策略,即保留何种环境信息及如何加载至模型上下文,我们认为此选择尤为关键。当前上下文管理方法面临显著权衡:保留更多信息会降低相关细节的检索效率。我们提出PRO-LONG,一种面向长时程探索场景的最小化上下文管理框架,核心是程序化记忆。它通过维护完整结构化的交互日志,并利用近期编码代理进展实现高效历史搜索。在完整的ARC-AGI-3公开游戏集上,PRO-LONG相比基础编码代理平均提升18.0个百分点,达到或超过最先进的专用框架(最高76.1% pass@1),同时仅消耗4.2-5.8倍更少的token。使用Fable 5时,达到97.4% best@2,总成本为$1,750。相关代码与日志见https://github.com/alexisfox7/PRO-LONG。

原文摘要 · Abstract (English)

Long-horizon tasks require sustained perception, reasoning, and exploration, and are a persistent challenge for large language model (LLM) agents. This gap is reflected in their limited performance on continual learning benchmarks such as ARC-AGI-3, especially when models are evaluated out of the box. Various agent harnesses have been proposed to close this gap, and each commits to a strategy for handling long sequences of observations, i.e., what information to save from the environment and how to load it into model context, a choice we argue is particularly consequential. Existing methods for context management face a significant tradeoff, as preserving more information makes retrieving relevant details less tractable. We propose PRO-LONG, a minimal context management framework built around programmatic memory for LLM agents in long-horizon, exploratory settings. PRO-LONG addresses the tradeoff by keeping a complete, structured interaction log and capitalizing on recent progress in coding agents to search this history efficiently. On the full ARC-AGI-3 public game set, PRO-LONG improves over a base coding agent by an average of 18.0 percentage points across frontier models, and matches or exceeds state-of-the-art specialized harnesses (up to 76.1% pass@1) while using 4.2-5.8x fewer tokens. With Fable 5, PRO-LONG achieves 97.4% best@2 at a total cost of \$1,750. Relevant code and logs are available at https://github.com/alexisfox7/PRO-LONG.

长时推理程序化记忆智能体编码代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。