arXiv:2605.05701cs.AI2026-05被引 10

通过动态分配推理预算,提升大模型搜索代理的多跳问答准确率。

Inference-Time Budget Control for LLM Search Agents

论文配图:Inference-Time Budget Control for LLM Search Agents
图 1 · 摘自论文原文
  • 引入任务级信息价值评分,决定每步该检索、拆解还是回答。
  • 在四个基准上,各模型和预算下均优于基线,最高提升12.3%。
  • 适合需要高效利用计算资源的复杂问答系统研发者。

大模型搜索代理在推理时依赖工具,但其轨迹常受工具调用次数与生成词数双重硬性限制。在此双重预算约束下,更优答案不仅需更强模型,还需明确控制下一步应分配预算的动作及何时积累足够证据可提交最终答案。本文在多跳问答任务中提出两阶段推理时预算控制机制:搜索阶段,控制器为每个可行动作计算任务级信息价值(VOI)得分,即单位预算在当前状态下对任务价值的边际贡献,据此选择检索、分解或答案提交;搜索后,选择性基于证据的终稿器将轨迹答案与优化候选进行比较,仅当残差误差显示为低风险答案格式错误时才重写。在四个多跳问答基准、三种LLM主干模型及四种预算水平下,该方法在相同硬性双重预算协议下,整体性能超越四个审计基线。消融实验表明,搜索阶段的预算控制(尤其是预算相关惩罚)带来主要性能提升,而答案阶段控制在检索路径已充分时才有帮助。结果表明,大模型搜索代理的推理时预算控制应同时管理搜索过程中的预算支出方式与最终答案的提交策略。

原文摘要 · Abstract (English)

LLM search agents increasingly rely on tools at inference time, but their trajectories are often constrained by hard limits on both tool calls and generated tokens. Under such dual budgets, better answers require not only stronger models, but also explicit control over which search action should receive the next budget unit and when the accumulated evidence is sufficient to commit a final answer. We study this problem in multi-hop question answering (QA) and formulate it as two-stage inference-time budget control. At search time, our controller assigns each feasible action a task-level Value-of-Information (VOI) score, defined as an operational estimate of marginal task value per unit budget under the current search state and remaining dual budget, and uses this score to choose among retrieval, decomposition, and answer commitment. After search, a selective evidence-grounded finalizer compares the trajectory answer with a refined candidate and rewrites only when the residual error appears to be a low-risk answer-form error. Across four multi-hop QA benchmarks, three LLM backbones, and four budget levels, the method yields positive aggregate gains over four audited baselines under the same hard dual-budget protocol. Ablations show that search-time budget control, especially budget-dependent penalty, provides the main performance gain, while answer-time control helps mainly when the retrieval path is already adequate. These results suggest that inference-time budget control for LLM search agents should govern both how budget is spent during search and how the final answer is committed.

大模型推理优化多跳问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。