arXiv:2604.15097cs.SEcs.CL2026-04被引 8

用紧凑基因表示法让经验可演化,提升代码求解成功率。

From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution

论文配图:From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution
图 1 · 摘自论文原文
  • 提出紧凑的'基因'表示法替代冗长技能文档
  • 基因在测试时进化使准确率从9.1%提至18.57%
  • 适合需要持续优化的自动化求解系统

本技术报告探讨如何有效表征可复用经验,使其在测试时具备控制能力并支持迭代演化。我们在45个科学代码求解场景中进行了4,590次受控实验。结果表明,以文档为导向的技能包难以提供稳定控制:其有效信号稀疏,扩展为完整文档反而常导致性能下降。相比之下,紧凑的基因(Gene)表示法在整体平均表现上最强,对结构扰动鲁棒,且优于同等预算的技能片段。此外,基因更适合作为经验积累载体:附加失败历史时,基因的表现优于技能或自由文本;结构可编辑性比内容更重要;将失败信息提炼为紧凑警告比直接追加更有效。在CritPt数据集上,基因演化系统性能从9.1%提升至18.57%,从17.7%提升至27.14%。结果表明,经验复用的核心问题不在于提供更多经验,而在于将其编码为紧凑、可控、可演化的对象。

原文摘要 · Abstract (English)

This beta technical report asks how reusable experience should be represented so that it can function as effective test-time control and as a substrate for iterative evolution. We study this question in 4.590 controlled trials across 45 scientific code-solving scenarios. We find that documentation-oriented Skill packages provide unstable control: their useful signal is sparse, and expanding a compact experience object into a fuller documentation package often fails to help and can degrade the overall average. We further show that representation itself is a first-order factor. A compact Gene representation yields the strongest overall average, remains competitive under substantial structural perturbations, and outperforms matched-budget Skill fragments, while reattaching documentation-oriented material usually weakens rather than improves it. Beyond one-shot control, we show that Gene is also a better carrier for iterative experience accumulation: attached failure history is more effective in Gene than in Skill or freeform text, editable structure matters beyond content alone, and failure information is most useful when distilled into compact warnings rather than naively appended. On CritPt, gene-evolved systems improve over their paired base models from 9.1% to 18.57% and from 17.7% to 27.14%. These results suggest that the core problem in experience reuse is not how to supply more experience, but how to encode experience as a compact, control-oriented, evolution-ready object.

经验演化代码求解基因表示测试时学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。