arXiv:2511.11519cs.AIcs.LG2025-11被引 2

让AI在推理时根据经验动态调整解题策略,提升效率与准确率。

Experience-Guided Adaptation of Inference-Time Reasoning Strategies

  • 基于经验生成完整计算策略,可动态调整提示、采样参数和工具配置。
  • 在5个难题上最高提升14%准确率,计算成本降低最多111倍。
  • 适合需要自适应推理的智能体系统,尤其在资源受限场景下优势明显。

使智能体在训练后能根据交互经验自适应调整问题求解方式,仍是根本挑战。现有方法仅通过修改语言模型输入来引导系统,无法改变采样参数、移除工具、修改系统提示或切换代理与工作流模式。而更灵活的系统需离线优化,部署后即固定不变。我们提出经验引导推理器(EGuR),基于积累的经验在推理时动态生成完整策略——包含LLM调用、工具使用、采样参数和控制逻辑的计算过程。通过一个基于LLM的元策略(输出策略的策略),实现所有策略组件(提示、采样参数、工具配置、控制逻辑)的自适应。EGuR由两个组件构成:引导者(Guide)根据当前问题和结构化记忆生成多个候选策略;整合者(Consolidator)利用执行反馈优化未来策略生成。这生成了针对每个问题量身定制、可缓存、按需执行的完整策略,避免资源浪费。在五个挑战性基准(AIME 2025、3-SAT及三个Big Bench Extra Hard任务)上,EGuR相比最强基线最高提升14%准确率,计算成本减少最多111倍,且随着经验积累,两项指标持续优化。

原文摘要 · Abstract (English)

Enabling agentic AI systems to adapt their problem-solving approaches based on post-training interactions remains a fundamental challenge. While systems that update and maintain a memory at inference time have been proposed, existing designs only steer the system by modifying textual input to a language model or agent, which means that they cannot change sampling parameters, remove tools, modify system prompts, or switch between agentic and workflow paradigms. On the other hand, systems that adapt more flexibly require offline optimization and remain static once deployed. We present Experience-Guided Reasoner (EGuR), which generates tailored strategies -- complete computational procedures involving LLM calls, tools, sampling parameters, and control logic -- dynamically at inference time based on accumulated experience. We achieve this using an LLM-based meta-strategy -- a strategy that outputs strategies -- enabling adaptation of all strategy components (prompts, sampling parameters, tool configurations, and control logic). EGuR operates through two components: a Guide generates multiple candidate strategies conditioned on the current problem and structured memory of past experiences, while a Consolidator integrates execution feedback to improve future strategy generation. This produces complete, ready-to-run strategies optimized for each problem, which can be cached, retrieved, and executed as needed without wasting resources. Across five challenging benchmarks (AIME 2025, 3-SAT, and three Big Bench Extra Hard tasks), EGuR achieves up to 14% accuracy improvements over the strongest baselines while reducing computational costs by up to 111x, with both metrics improving as the system gains experience.

智能体推理优化自适应大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。