arXiv:2608.23200cs.CL2026-08

将验证过的长流程执行经验封装为可复用基因,提升模型任务完成率。

LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks

论文配图:LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks
图 1 · 摘自论文原文
  • 用验证轨迹构建结构化基因,保存成功执行路径
  • 在252个任务上,基因比技能高出8.7-15.5个百分点
  • 适合需要复杂流程的模型迭代与部署场景

大型语言模型需执行依赖多步约束的复杂工作流,其成功经验常在单次运行后丢失。本文提出通过EvoMap将验证通过的执行轨迹整合为结构化基因,实现经验外化与复用。为此构建了包含778项机器可验证任务的LongWoF-Bench,涵盖代码生成、智能体环境合成、数学推理和规则遵循。在252个具有验证轨迹的Opus任务中,演化后的EvoMap基因在七种评估模型上均优于传统技能(提升8.7-15.5个百分点),且优势延伸至不同模型家族的消费级模型。相比之下,仅基于参考数据蒸馏的基因未展现同等优势,表明紧凑表示本身不足,基因效用与经验证的真实执行经历密切相关。对Claude Opus而言,基因复用使任务完成数增加39项,同时减少9.9%的求解时令牌消耗。结果表明,经验证的执行经验可作为可复用外部资源,显著提升长工作流完成率,避免重复探索代价。

原文摘要 · Abstract (English)

Large language models are increasingly expected to execute complex workflows whose success depends on maintaining interdependent constraints and producing artifacts that satisfy strict end-to-end verification. Yet successful execution experience is typically lost after a single run, forcing subsequent models to rediscover strategies and failure modes from scratch. We study whether such experience can instead be externalized and reused through EvoMap, where verifier-confirmed execution trajectories are consolidated into structured Gene. To evaluate this setting, we introduce the Long-Workflow Benchmark (LongWoF-Bench), comprising 778 machine-verifiable tasks across code generation, agent-environment synthesis, mathematical reasoning, and rule following. On the 252 tasks with verifier-confirmed Opus trajectories, evolved EvoMap Gene outperform Skill across all seven evaluated models by 8.7-15.5 percentage points, with the gains extending to consumer models from different model families. In contrast, reference-distilled Gene do not exhibit the same advantage, indicating that compact representation alone is insufficient and that Gene utility is closely associated with verified experience provenance. For Claude Opus, Gene reuse also completes 39 more tasks than Skill while reducing solve-time token consumption by 9.9%. Together, these results show that verified execution experience can be retained and shared as a reusable external resource, enabling models to improve long-workflow completion without repeatedly paying the full cost of experience discovery.

长流程任务EvoMap基因复用可验证性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。