arXiv:2508.00890cs.AIcs.CL2025-08NeurIPS被引 16

用智能代理动态分配计算资源,让大模型在复杂任务中更省力更高效。

AgentTTS: Large Language Model Agent for Test-time Compute-optimal Scaling Strategy in Complex Tasks

  • 设计智能代理通过试错反馈自动寻找最优模型与算力分配方案。
  • 在六个数据集上实验表明,搜索效率远超传统方法且性能更稳定。
  • 适合需要多步骤推理的复杂应用,如智能客服、自动化决策系统。

测试时扩展(TTS)通过在推理阶段分配额外计算资源来提升大语言模型(LLM)的性能。然而,现有研究主要集中在单阶段任务;而现实中许多问题属于多阶段复杂任务,由一系列异构子任务组成,每个子任务需具备特定能力的LLM。因此,我们研究了一个新问题:在多阶段复杂任务中实现测试时计算资源最优扩展,目标是为每个子任务选择合适模型并分配预算以最大化整体性能。多阶段任务中的TTS引入两个根本挑战:(i) 模型与预算分配的组合搜索空间庞大,结合高成本的推理,使暴力搜索不可行;(ii) 各子任务间的最优模型与预算分配相互依赖,增加了计算最优搜索的复杂性。为填补这一空白,我们在四个任务和六个数据集上开展广泛预实验,总结出三条关于LLM在多阶段复杂任务中行为的实证洞察。基于这些洞察,我们提出AgentTTS——一种基于大语言模型代理的框架,通过与执行环境的迭代反馈式交互,自主搜索计算最优分配。实验结果表明,AgentTTS在搜索效率上显著优于传统及其它基于LLM的基线方法,并在不同训练集规模下表现出更强鲁棒性与更高可解释性。

原文摘要 · Abstract (English)

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world problems are multi-stage complex tasks, composed of a sequence of heterogeneous subtasks with each subtask requires LLM of specific capability. Therefore, we study a novel problem: the test-time compute-optimal scaling in multi-stage complex tasks, aiming to select suitable models and allocate budgets per subtask to maximize overall performance. TTS in multi-stage tasks introduces two fundamental challenges: (i) The combinatorial search space of model and budget allocations, combined with the high cost of inference, makes brute-force search impractical. (ii) The optimal model and budget allocations across subtasks are interdependent, increasing the complexity of the compute-optimal search. To address this gap, we conduct extensive pilot experiments on four tasks across six datasets, deriving three empirical insights characterizing the behavior of LLMs in multi-stage complex tasks. Informed by these insights, we propose AgentTTS, an LLM-agent-based framework that autonomously searches for compute-optimal allocations through iterative feedback-driven interactions with the execution environment. Experimental results demonstrate that AgentTTS significantly outperforms traditional and other LLM-based baselines in search efficiency, and shows improved robustness to varying training set sizes and enhanced interpretability.

大模型智能代理计算优化多阶段任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。