arXiv:2607.06140cs.CL2026-07

让训练数据自动进化,针对智能体失败模式动态优化数据质量。

CurateEvo: Data-Curation Evolving for Agentic Post-Training

论文配图:CurateEvo: Data-Curation Evolving for Agentic Post-Training
图 1 · 摘自论文原文
  • 将数据筛选策略编码为可执行代码,根据失败轨迹迭代优化。
  • 在多个基准上提升平均得分3.2和2.7点,显著优于传统方法。
  • 兼容多种训练流程,大幅降低人工调参与数据准备成本。

大型语言模型智能体需要后训练方法来通过环境反馈提升长周期决策能力。然而,现有智能体后训练流程常将数据筛选视为固定预处理步骤,主要关注数据增强,忽视过滤、精炼及对下游失败的适应。我们提出CurateEvo,一种基于失败驱动的动态演化框架,用于智能体后训练中的数据筛选。CurateEvo将筛选策略表示为可执行代码,并利用保留开发集中的失败轨迹迭代重写该策略。每轮中,演化后的策略将固定原始语料转化为监督微调数据、强化学习数据和推理时的记忆库。演化过程首先通过诊断重复失败模式,相应地进行数据增强、过滤或精炼以提升有效性;随后在成本感知目标下剪枝冗余或低效训练回合以提升效率。在ACEBench-Agent、BFCL-V4和τ^2-Bench三个基准上,无论标注数据还是野数据设置下,CurateEvo均持续超越先前筛选方法,平均得分分别提升3.2和2.7分。进一步分析表明,CurateEvo兼容不同后训练范式,显著减少数据筛选开销。

原文摘要 · Abstract (English)

Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and τ^2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.

智能体数据演化后训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。