扩散语言模型在智能体任务中表现不佳,效率优势难掩其推理缺陷。
The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check
- 用扩散模型替代自回归模型以提升响应速度
- 在长周期规划和精准格式任务中频繁失败
- 适合用于非因果任务如记忆摘要,不适合核心推理
追求实时智能体交互推动了基于扩散的大型语言模型(dLLMs)的发展,作为自回归模型的替代方案,旨在突破序列延迟瓶颈。然而,这种效率提升是否带来有效的智能体行为?本文对LLaDA、Dream等dLLMs在两类智能体范式——具身智能体(需长时程规划)与工具调用智能体(需精确格式)——上进行了全面评估。结果揭示了一条‘苦涩的教训’:当前dLLMs无法作为可靠的智能体核心,常导致系统性失败。具体表现为:(1) 在具身场景下,因无法根据时间反馈正确分支而重复尝试;(2) 在工具调用场景中,扩散噪声导致难以维持符号精度(如严格的JSON schema)。为评估其潜力,我们提出DiffuAgent多智能体评估框架,将dLLMs作为即插即用的认知核心。分析表明,dLLMs在非因果任务(如记忆摘要、工具选择)中有效,但必须在去噪过程中融入因果性、精确性和逻辑基础推理机制,才可能适用于智能体任务。
原文摘要 · Abstract (English)
The pursuit of real-time agentic interaction has driven interest in Diffusion-based Large Language Models (dLLMs) as alternatives to auto-regressive backbones, promising to break the sequential latency bottleneck. However, does such efficiency gains translate into effective agentic behavior? In this work, we present a comprehensive evaluation of dLLMs (e.g., LLaDA, Dream) across two distinct agentic paradigms: Embodied Agents (requiring long-horizon planning) and Tool-Calling Agents (requiring precise formatting). Contrary to the efficiency hype, our results on Agentboard and BFCL reveal a "bitter lesson": current dLLMs fail to serve as reliable agentic backbones, frequently leading to systematically failure. (1) In Embodied settings, dLLMs suffer repeated attempts, failing to branch under temporal feedback. (2) In Tool-Calling settings, dLLMs fail to maintain symbolic precision (e.g. strict JSON schemas) under diffusion noise. To assess the potential of dLLMs in agentic workflows, we introduce DiffuAgent, a multi-agent evaluation framework that integrates dLLMs as plug-and-play cognitive cores. Our analysis shows that dLLMs are effective in non-causal roles (e.g., memory summarization and tool selection) but require the incorporation of causal, precise, and logically grounded reasoning mechanisms into the denoising process to be viable for agentic tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。