arXiv:2510.04573cs.LGcs.AI2025-10被引 20

用潜在扩散模型提升大模型推理,实现更高效多样的思维路径探索。

LaDiR: Latent Diffusion Enhances LLMs for Text Reasoning

  • 将思维过程编码为连续潜空间,通过潜扩散模型迭代优化。
  • 在数学、编程和谜题任务上准确率显著提升,多样性优于传统方法。
  • 适合需要多角度推理的复杂问题求解,尤其擅长避免重复答案。

大语言模型(LLM)通过思维链(CoT)生成展现推理能力,但自回归解码难以全局回溯和精炼早期内容,导致探索效率低且解法趋同。本文提出LaDiR(潜扩散推理器),将连续潜表示与潜扩散模型的迭代精炼能力结合,统一增强现有LLM的推理性能。首先利用变分自编码器(VAE)构建结构化潜推理空间,将文本推理步骤编码为思维块,保留语义信息并实现紧凑表达。随后,采用潜扩散模型以块级双向注意力掩码学习去噪思维块,支持长程迭代优化与动态测试时计算。该设计结合扩散推理中的显式多样性引导,生成多个探索潜空间不同区域的多样化推理轨迹,避免传统自回归采样中重复解的问题。在数学推理、代码生成和谜题规划等基准上评估显示,LaDiR在准确性、多样性和可解释性上均优于现有自回归、扩散及潜推理方法,揭示了基于潜扩散的新一代文本推理范式。

原文摘要 · Abstract (English)

Large Language Models (LLMs) demonstrate their reasoning ability through chain-of-thought (CoT) generation. However, LLM's autoregressive decoding may limit the ability to revisit and refine earlier tokens in a holistic manner, which can also lead to inefficient exploration for diverse solutions. In this paper, we propose LaDiR} (Latent Diffusion Reasoner), a novel reasoning framework that unifies the expressiveness of continuous latent representation with the iterative refinement capabilities of latent diffusion models for an existing LLM. We first construct a structured latent reasoning space using a Variational Autoencoder (VAE) that encodes text reasoning steps into blocks of thought tokens, preserving semantic information and interpretability while offering compact but expressive representations. Subsequently, we utilize a latent diffusion model that learns to denoise a block of latent thought tokens with a blockwise bidirectional attention mask, enabling longer horizon and iterative refinement with adaptive test-time compute. This design, combined with explicit diversity guidance during diffusion inference, enables the generation of multiple diverse reasoning trajectories that explore distinct regions of the latent space, rather than producing repetitive solutions as often occurs in standard autoregressive sampling. We conduct evaluations on a suite of mathematical reasoning, code generation and puzzle planning benchmarks. Empirical results show that LaDiR consistently improves accuracy, diversity, and interpretability over existing autoregressive, diffusion-based, and latent reasoning methods, revealing a new paradigm for text reasoning with latent diffusion.

文本推理扩散模型大模型多样性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。