让智能体学会何时用技能、何时跳过,提升任务成功率。
Skill or Skip? Learning Selective Skill Invocation in Agentic Tasks via Dual-Granularity Preference Learning
- 设计双粒度偏好学习框架,判断是否该调用技能
- 在ALFWorld上任务成功率提升10.9点,执行精度高29.1点
- 适合需要精准控制技能调用的复杂任务场景
智能体技能是可调用的过程模块,用于复杂任务中的知识复用与执行策略。现有方法多关注技能选择或技能优化,却忽略了在当前决策点是否应真正调用相关技能。不当调用会引入无关上下文,破坏原有正确执行流程。为此,我们提出SelSkill,一种面向选择性技能调用的双粒度偏好学习框架。该框架将技能使用建模为“调用或跳过”决策,利用预测不确定性筛选候选决策点,并从共享轨迹前缀构建可控的调用-跳过偏好对。进一步融合回合级结果偏好与步骤级调用偏好,兼顾整体轨迹质量与技能调用的局部有效性。在ALFWorld上使用Qwen3-8B,SelSkill相比启用了技能的基线任务成功率提升10.9点,比无技能方案高7.8点,执行精度高出29.1点;在BFCL上,任务成功率与执行精度分别提升5.7和29.5点。零样本测试在Tau-bench和PopQA上显示部分跨领域与跨技能迁移能力。
原文摘要 · Abstract (English)
Agent skills are callable procedural modules that provide reusable knowledge and execution policies for complex agentic tasks. However, existing methods mainly focus on selecting relevant skills or improving the skills themselves, while overlooking whether a relevant skill should actually be invoked at the current decision point. Unhelpful invocations may introduce irrelevant context and disrupt an otherwise correct execution process. To address this issue, we propose SelSkill, a dual-granularity preference-learning framework for selective skill invocation. SelSkill formulates skill use as a skill-or-skip decision, uses predictive uncertainty to prioritize candidate decision points, and constructs controlled invoke-skip preference pairs from shared trajectory prefixes. It further combines episode-level outcome preferences with step-level invocation preferences to capture both overall trajectory quality and the local effectiveness of skill invocation. On ALFWorld with Qwen3-8B, SelSkill improves task success by 10.9 points over the skill-enabled baseline and 7.8 over No-Skill, with 29.1-point higher execution precision. On BFCL, task success and execution precision improve by 5.7 and 29.5 points, respectively. Zero-shot results on Tau-bench and PopQA suggest partial transfer to unseen domains and skills.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。