arXiv:2608.18524cs.CLcs.AI2026-08

让多轮工具调用智能体学会高效探索,避免路径僵化。

DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents

论文配图:DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents
图 1 · 摘自论文原文
  • 用图结构建模探索路径的钻石拓扑,保留多种有效解法。
  • 识别关键断裂点,只修正错误路径,不破坏正确推理前缀。
  • 适合复杂多步任务的智能体训练,提升策略多样性与成功率。

为大语言模型赋予多轮工具调用能力是构建自主智能体的关键。然而,现有方法严重依赖完整轨迹模仿,导致在涉及多个无序子目标的任务中,最优解空间形成的庞大组合钻石拓扑被压缩为单一路径,引发严重的拓扑坍塌,惩罚合法替代探索,极大削弱策略多样性。为此,我们提出DART-SD(钻石拓扑感知的检索与微调用于自蒸馏),将范式从全局强制转向拓扑引导的局部修正。DART-SD首先将执行过程建模为收敛的交互-状态转移图(ISTG),忠实捕捉成功与失败探索路径的内在钻石拓扑。在自主滚动中,框架识别关键拓扑断裂点(CTB),并检索支持成功的恢复参考。最后,通过CTB引导的局部监督,引入渐进式自蒸馏机制,仅在生成的恢复步骤上计算训练损失,严格保护有效推理前缀免受破坏性梯度更新。在复杂多轮工具调用基准上的实验表明,DART-SD显著优于传统全轨迹基线。

原文摘要 · Abstract (English)

Equipping Large Language Models (LLMs) with multi-turn tool-calling capabilities is essential for building autonomous agents. However, progress is fundamentally limited by the reliance on full-length trajectory imitation. For tasks involving multiple order-independent sub-goals, the optimal solution space forms a vast combinatorial diamond lattice. Forcing this rich topology into monolithic trajectories causes a severe topological collapse, indiscriminately penalizing valid alternative explorations and severely degrading policy diversity. To address this, we propose DART-SD (Diamond-topology Aware Retrieval and Tuning for Self-Distillation), a novel framework that shifts the paradigm from global forcing to topology-guided localized correction. DART-SD first models the execution process as a converging Interaction-State Transition Graph (ISTG), faithfully capturing the inherent diamond topology of successful and failed exploratory paths. During autonomous rollouts, the framework identifies the Critical Topological Breakpoint (CTB) and retrieves success-supported recovery references. Finally, we introduce a progressive self-distillation paradigm through CTB-guided localized supervision, ensuring that the training loss is calculated exclusively on the generated recovery steps while strictly protecting the valid reasoning prefix from destructive gradient updates. Experiments on complex multi-turn tool-calling benchmarks demonstrate that DART-SD significantly outperforms traditional full-trajectory baselines.

智能体自蒸馏多轮调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。