用提炼经验优化大模型推理,提升效率与效果。
Decocted Experience Improves Test-Time Inference in LLM Agents
- 从经验中提炼核心信息构建上下文,替代盲目增加计算
- 在数学、编程等任务中显著提升推理准确率,节省算力
- 适合需要高效推理的智能体应用,如自动编程与复杂决策
当前对大语言模型的改进越来越关注不更新参数的前提下提升性能。测试时扩展(test-time scaling)是一种常见方法,通过延长推理时间(如更长的思考、采样或搜索)来提高表现。然而,在复杂推理和代理任务中,单纯扩大测试时计算量会显著增加成本,且常导致资源浪费于低效探索。本文提出将上下文作为补充的扩展维度,系统研究如何通过经验构建更优输入以引导推理。我们发现,有效上下文构建关键在于“提炼经验”(decocted experience)——从过往经验中提取本质、有序组织并检索关键信息。实验验证了该机制在数学推理、网页浏览和软件工程等任务中的有效性,表明积累经验可显著提升性能,同时减少无效计算。
原文摘要 · Abstract (English)
There is growing interest in improving LLMs without updating model parameters. One well-established direction is test-time scaling, where increased inference-time computation (e.g., longer reasoning, sampling, or search) is used to improve performance. However, for complex reasoning and agentic tasks, naively scaling test-time compute can substantially increase cost and still lead to wasted budget on suboptimal exploration. In this paper, we explore \emph{context} as a complementary scaling axis for improving LLM performance, and systematically study how to construct better inputs that guide reasoning through \emph{experience}. We show that effective context construction critically depends on \emph{decocted experience}. We present a detailed analysis of experience-augmented agents, studying how to derive context from experience, how performance scales with accumulated experience, what characterizes good context, and which data structures best support context construction. We identify \emph{decocted experience} as a key mechanism for effective context construction: extracting essence from experience, organizing it coherently, and retrieving salient information to build effective context. We validate our findings across reasoning and agentic tasks, including math reasoning, web browsing, and software engineering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。