arXiv:2602.02619cs.LGcs.AI2026-02被引 3

用代码合并请求序列构建高效长程智能体训练数据

daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently

  • 从真实软件迭代中提取合并请求序列作为监督信号
  • 生成平均85k token、116次工具调用的长序列轨迹
  • 仅用239条数据即实现47%基准提升,适合长周期任务研究

尽管大语言模型在短期任务上表现优异,但将其扩展到长周期智能体工作流仍面临挑战。核心瓶颈在于缺乏能捕捉真实长依赖结构和跨阶段演化动态的训练数据。现有合成方法或受限于单一特征,或需高昂人工标注成本,难以提供可扩展的高质量监督。本文提出daVinci-Agency,通过重构数据合成视角,利用真实软件演进中的合并请求(PR)序列作为监督信号。这些序列将复杂目标分解为可验证的提交单元,保持迭代间的功能一致性,并通过漏洞修复历史编码真实优化模式。该方法通过三个互锁机制实现:(1)通过持续提交进行渐进式任务分解,(2)通过统一功能目标保证长期一致性,(3)基于真实漏洞修复轨迹实现可验证优化。相比独立处理每一步的合成轨迹,daVinci-Agency的PR基础结构天然保留因果依赖与迭代优化,支持持久目标导向行为的教学,并自然契合项目级全周期任务建模。生成的轨迹规模庞大——平均85,000个标记符和116次工具调用——却极为数据高效:仅用239条daVinci-Agency样本微调GLM-4.6,就在多个基准上取得显著提升,尤其在Toolathlon上实现47%的相对增益。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) excel at short-term tasks, scaling them to long-horizon agentic workflows remains challenging. The core bottleneck lies in the scarcity of training data that captures authentic long-dependency structures and cross-stage evolutionary dynamics--existing synthesis methods either confine to single-feature scenarios constrained by model distribution, or incur prohibitive human annotation costs, failing to provide scalable, high-quality supervision. We address this by reconceptualizing data synthesis through the lens of real-world software evolution. Our key insight: Pull Request (PR) sequences naturally embody the supervision signals for long-horizon learning. They decompose complex objectives into verifiable submission units, maintain functional coherence across iterations, and encode authentic refinement patterns through bug-fix histories. Building on this, we propose daVinci-Agency, which systematically mines structured supervision from chain-of-PRs through three interlocking mechanisms: (1) progressive task decomposition via continuous commits, (2) long-term consistency enforcement through unified functional objectives, and (3) verifiable refinement from authentic bug-fix trajectories. Unlike synthetic trajectories that treat each step independently, daVinci-Agency's PR-grounded structure inherently preserves the causal dependencies and iterative refinements essential for teaching persistent goal-directed behavior and enables natural alignment with project-level, full-cycle task modeling. The resulting trajectories are substantial--averaging 85k tokens and 116 tool calls--yet remarkably data-efficient: fine-tuning GLM-4.6 on 239 daVinci-Agency samples yields broad improvements across benchmarks, notably achieving a 47% relative gain on Toolathlon. Beyond benchmark performance, our analysis confirms...

智能体数据合成长程推理代码生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。