arXiv:2602.07451cs.CL2026-02被引 4

用扩散模型替代自回归生成,让智能体决策更快更准。

DLLM Agent: See Farther, Run Faster

  • 在相同流程中对比扩散与自回归模型,发现扩散模型更高效。
  • 同等准确率下,平均提速超30%,部分场景快8倍以上。
  • 适合追求高效决策的工具调用智能体,需注意工具调用训练和注意力对齐。

扩散型大语言模型(DLLM)作为自回归(AR)解码的替代方案,展现出优异的效率与建模能力,但其在智能体多步决策中的影响仍不明确。本文在相同代理工作流(DeepDiver)中,使用相同轨迹数据进行匹配微调,构建了基于扩散模型的DLLM智能体与可比的AR智能体。实验表明,在保持相近准确率的前提下,DLLM智能体整体端到端速度平均提升30%以上,部分任务提速超过8倍。在正确完成任务的条件下,其交互轮次与工具调用次数更少,规划命中率更高,且更早收敛至正确行动路径,回溯更少。研究还发现:1)直接使用的DLLM策略易产生结构化工具调用失败,需强化工具调用特异性训练以生成有效参数;2)对于包含上下文与动作片段交替的多轮输入,扩散式片段破坏需配合适当注意力掩码,否则会导致上下文-动作信息误传播,性能下降。此外,对不同阶段注意力动态的分析揭示了范式特有的协调模式,扩散模型表现出更强的全局规划信号。

原文摘要 · Abstract (English)

Diffusion large language models (DLLMs) have emerged as an alternative to autoregressive (AR) decoding with appealing efficiency and modeling properties, yet their implications for agentic multi-step decision making remain underexplored. We ask a concrete question: when the generation paradigm is changed but the agent framework and supervision are held fixed, do diffusion backbones induce systematically different planning and tool-use behaviors, and do these differences translate into end-to-end efficiency gains? We study this in a controlled setting by instantiating DLLM and AR backbones within the same agent workflow (DeepDiver) and performing matched agent-oriented fine-tuning on the same trajectory data, yielding diffusion-backed DLLM Agents and directly comparable AR agents. Across benchmarks and case studies, we find that, at comparable accuracy, DLLM Agents are on average over 30% faster end to end than AR agents, with some cases exceeding 8x speedup. Conditioned on correct task completion, DLLM Agents also require fewer interaction rounds and tool invocations, consistent with higher planner hit rates that converge earlier to a correct action path with less backtracking. We further identify two practical considerations for deploying diffusion backbones in tool-using agents. First, naive DLLM policies are more prone to structured tool-call failures, necessitating stronger tool-call-specific training to emit valid schemas and arguments. Second, for multi-turn inputs interleaving context and action spans, diffusion-style span corruption requires aligned attention masking to avoid spurious context-action information flow; without such alignment, performance degrades. Finally, we analyze attention dynamics across workflow stages and observe paradigm-specific coordination patterns, suggesting stronger global planning signals in diffusion-backed agents.

扩散模型智能体高效推理工具调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。