让智能体通过假设验证自主进化技能,提升成功率。
SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitation

- 基于可验证的失败假设生成测试,用诊断证据替代环境交互
- 在5次迭代内达成55.9%~57.9%任务通过率,优于现有方法
- 适合需要低预算自适应演化的智能体系统,如真实部署场景
尽管智能体技能为大语言模型提供了可复用的过程知识,但手动维护成本高、难以扩展且易产生偏差。实际应用需在测试时实现受控的自主技能演化,受限于有限的交互预算和缺乏训练/验证集。此场景下存在严重稀疏奖励问题,结果混杂多种潜在失败原因。现有方法因贪婪优化单一技能,易陷入利用陷阱,早期误判会耗尽有限尝试。为此,我们提出SkillHEX,一种闭环框架,结合假设驱动的自我验证与证据引导的树搜索。SkillHEX将可证伪的失败假设转化为可执行测试,生成密集奖励证据而无需额外环境尝试。该证据指导对持续技能修订分支的搜索,动态平衡支持修改的利用与合理替代方案的探索。在SkillsBench的87个任务上评估,SkillHEX在使用GPT-5.3-Codex和Claude Opus 4.7时,分别达到55.9%和57.9%的平均通过率,五次迭代预算内表现领先现有自演化方法。
原文摘要 · Abstract (English)
Although agent skills equip LLMs with reusable procedural knowledge, manual maintenance suffers from high costs, unscalability, and misalignment. Real-world deployments thus require autonomous, on-demand skill evolution at test time, constrained by limited interaction budgets and a lack of training or validation sets. This setting introduces a severe sparse reward challenge, where outcomes conflate multiple latent failure causes. Under such ambiguity, existing methods that greedily refine a single incumbent skill are particularly vulnerable to an exploitation trap, allowing early misdiagnoses to exhaust limited trials along unproductive trajectories. To address this, we introduce SkillHEX, a closed-loop framework coupling hypothesis-driven self-verification with evidence-guided tree search. SkillHEX translates falsifiable failure hypotheses into executable tests, producing diagnostic evidence as dense reward without additional environment attempts. This evidence guides a search over persistent skill-revision branches, dynamically balancing the exploitation of supported edits with the exploration of plausible alternatives. Evaluated on 87 tasks from SkillsBench, SkillHEX outperforms existing self-evolving methods and achieves an average pass rate of 55.9% and 57.9% using GPT-5.3-Codex and Claude Opus 4.7 under a five-iteration budget, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。