arXiv:2607.26828cs.LGcs.AI2026-07

让大模型搜索更省钱,按成本算收益,省一半预算还能更好

Budget-Aware LLM Discovery via Cost-Calibrated Frontier Utility

  • 根据实际消耗的token成本调整奖励,避免无效探索
  • 在一半预算下达到最强基线的性能,8个任务全胜
  • 适合需要高效使用算力的研究者和工程团队

大语言模型通过推理时对候选方案的搜索支持科学与算法发现。现有自适应控制器仅依据得分提升分配奖励,却忽视提示长度、重试次数和引导调用带来的不同token成本。我们证明,忽略成本的奖励机制会导致几乎全部可达成质量的损失,尤其当搜索前沿增多、成本差异增大时。在固定搜索侧token预算下,控制器必须判断哪个前沿在进步,并评估其收益是否值得已发生的成本,以防预算耗尽。本文提出CostAda,一种基于成本校准前沿效用的自适应控制器。该效用将进展相对于实际成本进行衡量,并依赖剩余预算决定是否给予奖励。CostAda利用此信号控制局部探索强度、前沿分配及预算内策略干预。成本与剩余预算不再只是记账工具或停止条件,而是主动塑造搜索过程。在16组基准-主干组合中,CostAda以不超过一半预算达到最强基线的全预算表现;在所有8个基准上,使用GLM-5和GPT-5.4均取得最优平均最终质量。

原文摘要 · Abstract (English)

Large language models increasingly support scientific and algorithmic discovery through inference-time search over evaluated candidates. Existing adaptive discovery controllers assign credit based only on score progress, even though prompt length, retries, and guidance calls cause search actions to incur different token costs. We prove that cost-blind credit can forfeit all but a vanishing fraction of attainable quality as frontiers multiply and costs diverge. Under a fixed search-side token budget, the controller must decide which frontier is improving and whether its gain justifies the realized cost before the budget is exhausted. We introduce \textbf{CostAda}, a cost-calibrated adaptive controller built around \emph{cost-calibrated frontier utility}. The utility values frontier progress relative to realized action cost and conditions that credit on the remaining budget. CostAda uses this signal to control local exploration intensity, frontier allocation, and budgeted tactic intervention. Cost and remaining budget therefore shape the search rather than serving only as accounting variables or a stopping rule. CostAda reaches the strongest baseline's full-budget quality with at most half the budget on twelve of sixteen benchmark--backbone pairs while achieving the strongest mean final quality on all eight benchmarks under GLM-5 and GPT-5.4.

大模型搜索成本优化自适应控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。