让扩散模型更靠谱地看图推理,避免过早下结论。
Thinking Diffusion: Penalize and Guide Visual-Grounded Reasoning in Diffusion Multimodal Language Models
- 用位置和步数惩罚延迟答案生成,推动逐步推理
- 通过视觉引导增强图像信息利用,准确率最高提升7.5%
- 适合追求快速又准确的多模态推理任务开发者
扩散大语言模型(dLLMs)正成为自回归(AR)大模型的有力替代。近期该范式被拓展至多模态任务,催生了扩散多模态大语言模型(dMLLMs)。这类模型期望在保留语言模型推理能力的同时,通过并行生成实现更快推理。然而,当结合思维链(CoT)推理时,dMLLMs暴露出两个关键问题:其一,模型常在极早期时间步就生成最终答案,表明推理未充分展开;其二,初期时间步对视觉提示依赖极低,与AR视觉-语言模型的视觉利用模式截然不同。这说明dMLLMs倾向于过早给出答案且未充分基于视觉输入。为此,我们提出位置与步数惩罚(PSP)和视觉推理引导(VRG)。PSP在早期时间步惩罚靠后位置的词元,延缓过早答案生成,促进跨时间步的渐进推理;VRG受无分类器引导启发,强化视觉接地信号,提升模型与视觉证据的一致性。在多个dMLLM上的实验证明,本方法在保持推理速度优势的同时,准确率最高提升7.5%,且相比四倍更多扩散步数的推理方案提速超3倍。
原文摘要 · Abstract (English)
Diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive (AR) LLMs. Recently, this paradigm has been extended to multimodal tasks, leading to the development of diffusion multimodal large language models (dMLLMs). These models are expected to retain the reasoning capabilities of LLMs while enabling faster inference through parallel generation. However, when combined with Chain-of-Thought (CoT) reasoning, dMLLMs exhibit two critical issues. First, we observe that dMLLMs often generate the final answer token at a very early timestep. This trend indicates that the model determines the answer before sufficient reasoning, leading to degraded reasoning performance. Second, during the initial timesteps, dMLLMs show minimal dependency on visual prompts, exhibiting a fundamentally different pattern of visual information utilization compared to AR vision-language models. In summary, these findings indicate that dMLLMs tend to generate premature final answers without sufficiently grounding on visual inputs. To address these limitations, we propose Position and Step Penalty (PSP) and Visual Reasoning Guidance (VRG). PSP penalizes tokens in later positions during early timesteps, delaying premature answer generation and encouraging progressive reasoning across timesteps. VRG, inspired by classifier-free guidance, amplifies visual grounding signals to enhance the model's alignment with visual evidence. Extensive experiments across various dMLLMs demonstrate that our method achieves up to 7.5% higher accuracy while delivering more than 3x speedup compared to reasoning with four times more diffusion steps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。