让大模型学会总结抽象经验,持续提升推理能力。
ArcMemo: Abstract Reasoning Composition with Lifelong LLM Memory
- 从推理过程提取可复用的抽象概念,而非具体答案
- 在ARC-AGI上相对基线提升7.5%,且算力越多效果越好
- 适合需要长期积累和泛化推理的AI系统
尽管推理时扩展能让大模型执行更长、更复杂的推理链,但这些过程中发现的规律和洞见在上下文窗口重置后即被丢弃。外部记忆是保存这些发现的自然方式,近期研究已证明其在密集推理任务中的价值。我们提出将记忆从实例级(如精确问答对或与原问题强耦合的摘要)升级为概念级:从解题轨迹中提炼出可复用、模块化的自然语言抽象。对于新问题,相关概念被选择性检索并融入提示,实现无需权重更新的测试时持续学习。本设计引入新的抽象策略与检索机制,促进记忆复用,并支持随经验增加而扩展。我们在强调组合泛化与抽象推理的ARC-AGI基准上评估,结果表明该方法相比强基线提升7.5%相对性能,且表现随推理计算量增长持续提升。抽象概念始终优于基线,在所有测试计算规模下均表现更优。动态测试时更新记忆优于静态设置,支持了积累与抽象模式能带来自我改进的假设。代码已开源。
原文摘要 · Abstract (English)
While inference-time scaling enables LLMs to carry out increasingly long and capable reasoning traces, the patterns and insights uncovered during these traces are immediately discarded once the context window is reset for a new query. External memory is a natural way to persist these discoveries, and recent work has shown clear benefits for reasoning-intensive tasks. We see an opportunity to make such memories more broadly reusable and scalable by moving beyond instance-based memory entries (e.g. exact query/response pairs, or summaries tightly coupled with the original problem context) toward concept-level memory: reusable, modular abstractions distilled from solution traces and stored in natural language. For future queries, relevant concepts are selectively retrieved and integrated into the prompt, enabling test-time continual learning without weight updates. Our design introduces new strategies for abstracting takeaways from rollouts and retrieving entries for new queries, promoting reuse and allowing memory to expand with additional experiences. We evaluate on ARC-AGI, a benchmark that stresses compositional generalization and abstract reasoning, making it a natural fit for concept memory. Our method yields a 7.5% relative gain over a strong no-memory baseline with performance continuing to scale with inference compute. We find abstract concepts to be the most consistent memory design, outscoring the baseline at all tested inference compute scales. Moreover, dynamically updating memory during test-time outperforms fixed settings, supporting the hypothesis that accumulating and abstracting patterns enables further solutions in a form of self-improvement. Code is available at https://github.com/matt-seb-ho/arc_memo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。