arXiv:2509.01920cs.AIcs.LG2025-09被引 8

提出动态推测规划框架,实现零性能损失的高效推理加速。

Dynamic Speculative Agent Planning

  • 基于异步在线强化学习,动态调节推理过程以平衡延迟与成本。
  • 在标准基准上实现比肩最快方法的效率,总成本降低30%,额外开销减少60%。
  • 无需预训练,用户可通过单参数灵活控制加速与成本权衡,适合部署优化场景。

尽管基于大语言模型的智能体在复杂任务中取得显著成功并广泛采用,但其部署仍面临高昂延迟和推理成本的挑战。现有加速方法普遍存在性能失真、需大量离线训练路由模块或运营成本过高等问题,且难以灵活控制加速与性能间的权衡。为此,我们提出动态推测规划(DSP),一种异步在线强化学习框架,可在不增加预部署准备的前提下实现无损加速,并大幅降低运行成本。DSP 显式优化端到端延迟与美元成本的联合目标,仅通过调节单一参数即可在更快响应、更低开销或两者间任意平衡点之间自由切换。在两个标准智能体基准上的实验表明,DSP 的效率可媲美最快速的无损加速方法,同时总成本降低30%,不必要的开支最高减少60%。代码与数据已公开于 https://github.com/guanyilin428/Dynamic-Speculative-Planning。

原文摘要 · Abstract (English)

Despite their remarkable success in complex tasks propelling widespread adoption, large language-model-based agents still face critical deployment challenges due to prohibitive latency and inference costs. While recent work has explored various methods to accelerate inference, existing approaches suffer from significant limitations: they either fail to preserve performance fidelity, require extensive offline training of router modules, or incur excessive operational costs. Moreover, they provide minimal user control over the tradeoff between acceleration and other performance metrics. To address these gaps, we introduce Dynamic Speculative Planning (DSP), an asynchronous online reinforcement learning framework that provides lossless acceleration with substantially reduced costs without requiring additional pre-deployment preparation. DSP explicitly optimizes a joint objective balancing end-to-end latency against dollar cost, allowing practitioners to adjust a single parameter that steers the system toward faster responses, cheaper operation, or any point along this continuum. Experiments on two standard agent benchmarks demonstrate that DSP achieves comparable efficiency to the fastest lossless acceleration method while reducing total cost by 30% and unnecessary cost up to 60%. Our code and data are available through https://github.com/guanyilin428/Dynamic-Speculative-Planning.

推理加速强化学习成本优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。