arXiv:2608.07056cs.AI2026-08

用可演化性指导文本优化,让语言技能在不更新模型时也能持续进化。

BONSAI: Evolvability-Guided Tree Search over Skills

论文配图:BONSAI: Evolvability-Guided Tree Search over Skills
图 1 · 摘自论文原文
  • 以可演化性为引导,通过蒙特卡洛树搜索生成可改进的技能文本
  • 在三个基准上比无技能基线提升23.13分,优于两个对比方法
  • 适合需要持续优化提示词但无法微调模型的场景

技能是自然语言文档,用于引导权重冻结的智能体,其能力只能通过文本提供。优化技能即在评分体系下优化文本,传统方法仅接受提升得分的修改,却无法区分位于狭窄过拟合尖峰与宽广平台的文本——后者才具备继续改进潜力。我们提出BONSAI,一种基于可演化性的新技能优化框架,将演化潜力(即区域在进一步突变下仍能产生有效变体的能力)作为引导信号。BONSAI构建蒙特卡洛搜索树,每个子节点为父节点的突变,其选择规则结合自身得分与邻域得分的上界置信度。由于每个子节点都是突变,节点下的平均得分即可无成本估计邻域可演化性。该机制使预算集中在持续可改进的区域,同时探索当前较弱分支。使用冻结的300亿参数智能体,在三个基准上平均提升23.13分,优于两个预算匹配的基线(GEPA和SkillOpt),分别提升3.87和3.97分。

原文摘要 · Abstract (English)

A skill is a naturallanguage document that steers a frozen agent whose weights cannot be updated so any capability the agent lacks must be supplied in prose Optimising a skill is therefore optimising text against a score and the standard recipe which keeps any edit that raises a heldout score is blind in a specific way a single score cannot tell a document perched on a narrow overfit spike from one resting on a broad plateau even though only the second can still be improved We introduce BONSAI a novel skilloptimisation framework that steers instead by evolvability the capacity of a region of documentspace to keep producing viable variation under further mutation a property biology treats as separate from present fitness BONSAI grows skills as a MonteCarlo search tree in which every child document is a mutation of its parent and descends it under an upperconfidence selection rule whose exploitation term blends a skills own fitness with the fitness of its mutational neighbourhood Because every child is a mutation the mean score recorded beneath a node estimates that neighbourhoods evolvability at no extra cost so the rule concentrates budget on regions that keep improving while its exploration term keeps a currently weak branch in contention BONSAI ships the single bestscoring document it finds at no cost beyond the acceptifbetter loop it replaces With a frozen 30B agent and averaged over three benchmarks BONSAI lifts heldout accuracy over the skillfree agent by 2313 points and improves on two budgetmatched baselines GEPA and SkillOpt by 387 and 397 points respectively

技能优化文本生成搜索算法可演化性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。