用多样性提升代码智能体性能,突破数据量瓶颈。
Beyond Quantity: Trajectory Diversity Scaling for Code Agents
- 基于轨迹多样性设计数据合成框架,替代单纯增加数据量。
- 在固定预算下,多样性提升带来更大性能增益,显著改善性价比。
- 适合关注代码智能体训练效率与泛化能力的研究者。
随着代码大模型通过模型上下文协议(MCP)演变为工具交互智能体,其泛化能力日益受限于低质量合成数据及数量扩展的边际效益递减。现有数量中心的扩展策略存在早期瓶颈,未能充分利用轨迹数据。本文提出TDScaling,一种基于轨迹多样性的数据合成框架,通过提升多样性而非单纯增加数据量来提升智能体性能。在固定训练预算下,增加轨迹多样性带来的收益远超增加轨迹数量,显著优化了性能与成本的权衡。TDScaling集成四项创新:(1) 商业集群机制,捕捉真实服务逻辑依赖;(2) 蓝图驱动的多智能体范式,保障轨迹一致性;(3) 自适应演化机制,利用领域熵、推理模式熵和累积动作复杂度引导合成进入长尾场景,防止模式崩溃;(4) 受限沙箱代码工具,缓解内在编码能力的灾难性遗忘。在通用工具使用基准(BFCL, tau^2-Bench)和代码智能体任务(RebenchT, CodeCI, BIRD)上的实验表明,TDScaling实现了双赢:既提升工具使用泛化能力,又增强固有编码能力。论文计划在发表后开源完整代码库与合成数据集(含30,000+工具集群)。
原文摘要 · Abstract (English)
As code large language models (LLMs) evolve into tool-interactive agents via the Model Context Protocol (MCP), their generalization is increasingly limited by low-quality synthetic data and the diminishing returns of quantity scaling. Moreover, quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data. We propose TDScaling, a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. Under a fixed training budget, increasing trajectory diversity yields larger gains than adding more trajectories, improving the performance-cost trade-off for agent training. TDScaling integrates four innovations: (1) a Business Cluster mechanism that captures real-service logical dependencies; (2) a blueprint-driven multi-agent paradigm that enforces trajectory coherence; (3) an adaptive evolution mechanism that steers synthesis toward long-tail scenarios using Domain Entropy, Reasoning Mode Entropy, and Cumulative Action Complexity to prevent mode collapse; and (4) a sandboxed code tool that mitigates catastrophic forgetting of intrinsic coding capabilities. Experiments on general tool-use benchmarks (BFCL, tau^2-Bench) and code agent tasks (RebenchT, CodeCI, BIRD) demonstrate a win-win outcome: TDScaling improves both tool-use generalization and inherent coding proficiency. We plan to release the full codebase and the synthesized dataset (including 30,000+ tool clusters) upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。