arXiv:2605.22154cs.AI2026-05被引 1

利用等待时间提前规划,让大模型代理更高效

IdleSpec: Exploiting Idle Time via Speculative Planning for LLM Agents

论文配图:IdleSpec: Exploiting Idle Time via Speculative Planning for LLM Agents
图 1 · 摘自论文原文
  • 在等待观察结果时,批量生成多种推理计划候选
  • 在GAIA和FRAMES上准确率提升5.1%,最高达9.1%提升
  • 适合需要长时间执行的任务,如代码运行或复杂推理

基于大语言模型的智能体通过多步推理与工具调用解决复杂任务,但常因等待环境反馈而产生空闲时间。现有方法将空闲视为不可避免的开销,或仅提供受限方案,忽视不同工具调用的计算预算差异与未来观察的不确定性,导致空闲时间利用不足。本文提出IdleSpec,一种可扩展且通用的推理方法,通过利用空闲时间提升智能体性能,同时控制延迟。IdleSpec在空闲期迭代生成计划候选,并在观测可用时聚合以指导下一步推理。为应对观察不确定性,它从学习到的分布中采样互补的起草策略(渐进式与恢复式),并通过后验反馈持续更新。实验表明,IdleSpec显著提升了多种场景下的智能体表现:在GAIA和FRAMES上,使用Gemini-2.5-Flash时平均准确率达55.6%,较基线提升5.1%;在含长延迟的MLE-Bench上,任意奖牌率最高提升9.1%,证明其对长周期任务的良好泛化能力。

原文摘要 · Abstract (English)

Large language model (LLM)-based agents solve complex tasks by leveraging multi-step reasoning with iterative tool calls and environment interactions, which incur idle time while waiting for observations. Despite the prevalence of idle time in most agentic scenarios, existing works treat it as an unavoidable overhead or propose restricted solutions that overlook varying computational budgets across different tool calls and future observation uncertainty, thereby leading to suboptimal utilization of idle time. In this paper, we introduce IdleSpec, a scalable and generic inference approach that leverages idle-time computation to improve agent performance while minimizing latency overhead. Specifically, IdleSpec iteratively generates plan candidates during idle periods and, once observations become available, aggregates them to guide the next reasoning step. For effective plan generation under observation uncertainty, IdleSpec samples between complementary drafting strategies (i.e., progressive and recovery) from a learned distribution that is updated via posterior feedback. Our experiments demonstrate that IdleSpec significantly improves agent performance in various agentic scenarios by effectively utilizing idle time. In particular, on the GAIA and FRAMES, IdleSpec achieves 55.6% average accuracy with Gemini-2.5-Flash, surpassing the vanilla baseline without idle-time usage by 5.1%. Furthermore, for MLE-Bench, which involves substantial delay from code executions, IdleSpec achieves performance gains of up to 9.1% on the Any Medal rate, highlighting its generalizability to long-horizon tasks.

大模型代理推理优化空闲时间利用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。