用扩散模型规划+自回归模型执行,提升推理效率与准确率
Planner and Executor: Collaboration between Discrete Diffusion And Autoregressive Models in Reasoning
- 扩散模型做计划,自回归模型执行,分阶段协同推理
- 潜空间通信使准确率从27%升至54%,计算量仅1/44
- 适合追求高效高精度推理的AI系统研发者
当前自回归语言模型(ARMs)虽准确率高,但需长序列生成,成本高昂。离散扩散语言模型(DDLMs)可在固定步数内并行生成,近期在复杂推理与长期规划任务中表现优异。本文研究将DDLM与ARM结合的混合架构,探索二者协作的互补优势。首先在文本空间实现分工:一个模型规划推理过程,另一个根据计划生成答案。随后拓展至潜空间通信,引入可学习投影器将DDLM潜变量映射至ARM嵌入空间,以克服扩散模型的文本生成局限。结果显示,潜空间通信显著提升准确率:DART-5从27.0%增至54.0%,AIME24从0.0%增至14.0%。同时,采用64个令牌规划、约5个令牌执行的潜空间流程,在保持高精度的同时,计算量仅为Qwen3.1-7B的1/44,且性能超越其在DART-5和AIME上的表现。研究为使用DDLM进行推理提供了新视角,凸显其在混合架构中的潜力。
原文摘要 · Abstract (English)
Current autoregressive language models (ARMs) achieve high accuracy but require long token sequences, making them costly. Discrete diffusion language models (DDLMs) enable parallel and flexible generation within a fixed number of steps and have recently emerged for their strong performance in complex reasoning and long-term planning tasks. We present a study exploring hybrid architectures that couple DDLMs with ARMs to assess whether their collaboration can yield complementary benefits. We first examine collaboration in text space, where one model plans the reasoning process and another executes the final answer based on that plan. We then extend this setup to latent-space communication, introducing a learned projector that maps DDLM latents into the ARM's embedding space, potentially bypassing some of the text-generation limitations of diffusion models. We find that shifting DDLM --> ARM communication from text space to latent space yields significant accuracy gains, for example increasing from 27.0% to 54.0% on DART-5 and from 0.0% to 14.0% on AIME24. We also find that combining a DDLM planner with an ARM executor can provide substantial computational savings with little to no impact on accuracy. For example, the latent-space pipeline, using 64 tokens for planning and roughly 5 for execution, surpasses Qwen3.1-7B on DART-5 and AIME, despite Qwen using 44 times more tokens. Overall, our study offers new insights into reasoning with DDLMs and highlights their potential in hybrid architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。