arXiv:2608.09168cs.AI2026-08

让大模型智能判断该不该执行技能,省算力还提效果

From Relevance to Execution Utility: Reward-Aware Dynamic Execution Gating for Skill-Based LLM Agents

论文配图:From Relevance to Execution Utility: Reward-Aware Dynamic Execution Gating for Skill-Based LLM Agents
图 1 · 摘自论文原文
  • 用轻量代理模型预判技能组合执行价值,避免盲目试错
  • 在288次回溯中减少冗余执行,保留90%以上验证奖励
  • 只需更新少量参数即可适应新反馈,适合实际部署

大型语言模型(LLM)代理正越来越多地依赖可复用的技能库来实现程序化知识。尽管技能检索能力已显著提升,但检索到的技能组合未必值得执行。由于每个技能条件下的推理过程计算开销大,决定是否执行成为关键挑战。为此,本文提出奖励感知动态执行门控机制(RADEG),一个位于技能检索与执行之间的轻量级、无关检索器的决策层。RADEG学习一个低成本代理模型,可在昂贵的推理前预测查询-技能组合的执行效用。通过局部扰动检索到的技能组合(删除、添加或替换一项技能),生成同查询下的对比回溯,从而隔离组合变化对验证器奖励的影响,获取有效监督信号。部署时,仅需更新预热过的逻辑回归头以适应新反馈,无需重训检索器或代理。在288个收集回溯的查询级留出评估中,RADEG显著减少不必要的执行,同时保留大部分下游验证奖励,在不同执行预算下均优于基于相关性的随机门控策略,证明了执行感知代理建模是技能检索的有效且经济的补充。

原文摘要 · Abstract (English)

Agent skills are increasingly used to equip large language model (LLM) agents with reusable procedural knowledge. Although recent work has substantially improved skill retrieval due to the increasing skill libraries, retrieving a plausible skill bundle does not guarantee that executing it is worthwhile. Since every skill-conditioned rollout is computationally expensive, deciding whether a retrieved bundle should be executed has become an increasingly important challenge. To this end, we introduce the Reward-Aware Dynamic Execution Gate (RADEG), a lightweight, retriever-agnostic decision layer between skill retrieval and agent execution. RADEG learns a low-cost surrogate model that predicts the execution utility of a query--bundle pair before the expensive rollout is launched. To obtain informative supervision while controlling for task difficulty, we locally perturb each retrieved bundle by deleting, adding, or replacing one skill, producing matched same-query rollouts that isolate the effect of bundle composition on verifier reward. During deployment, RADEG updates only a warm-started logistic head as new verifier feedback becomes available, enabling inexpensive adaptation of the execute/skip boundary without retraining either the retriever or the agent. Under a query-level held-out evaluation on 288 collected rollouts, RADEG substantially reduces unnecessary agent executions while preserving a large fraction of the downstream verifier reward. It consistently outperforms relevance-based and random gating across different execution budgets, demonstrating that execution-aware surrogate modeling provides a practical and cost-effective complement to skill retrieval.

大模型代理技能调度执行优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。