arXiv:2607.24617cs.IR2026-07

用隐空间推理提升推荐效率,让大模型更懂用户多元兴趣

LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendation

论文配图:LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendation
图 1 · 摘自论文原文
  • 在隐空间中分步对齐推理过程,增强训练信号
  • 通过个性化高斯混合分布采样,探索多条推理路径
  • 兼顾效率与多样性,适合追求精准推荐的场景

大型语言模型(LLMs)在推荐系统中展现巨大潜力,因其强大的推理能力。然而,现有方法主要依赖显式的思维链(CoT),导致推理文本冗长、响应效率低。隐空间推理通过在连续隐空间内思考,提升了效率,但仍面临两大挑战:(1) 细粒度监督缺失:仅依靠最终标签反馈,难以有效指导多个隐藏推理步骤的优化;(2) 单一推理路径:隐空间推理的确定性限制了对用户多样化兴趣的探索,制约了推荐能力。为此,我们提出 $LaRec$,一个高效生成式推荐框架,旨在释放 LLM 隐空间推理的潜力。$LaRec$ 包含两个核心阶段:首先,设计隐空间预训练,通过步骤级对齐与过程方向对齐,向隐空间推理提供丰富监督信号;其次,引入个性化强化学习调优,基于用户历史兴趣构建个性化高斯混合分布,训练时从中随机采样不同推理起点,引导模型在隐空间中遍历多样路径,实现对用户多维度兴趣的高效探索。多数据集实验表明,$LaRec$ 显著优于现有基线,且保持相当的效率。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown great promise in recommendation due to superior reasoning abilities. However, existing methods mainly rely on explicit Chain-of-Thought (CoT), resulting in verbose reasoning texts and inefficient response times. latent reasoning aims to balance efficiency by thinking within a continuous latent space, yet it faces two major challenges: (1) Lack of Fine-grained Supervision: Latent reasoning relies solely on feedback from the final labels, providing sparse supervisory signals that struggle to effectively guide the optimization of multiple hidden reasoning steps. (2) Single Reasoning Path: The deterministic nature of latent reasoning impedes the exploration of users' diverse interests and preferences, thereby limiting the recommendation capabilities of LLMs. To address these issues, we propose \textbf{$LaRec$}, an efficient generative recommendation framework designed to unleash the potential of latent reasoning in LLMs. $LaRec$ consists of two core stages: First, we design Latent Pre-training that empowers LLMs with latent reasoning capabilities by providing rich supervisory signals to the latent space reasoning via step-level alignment and process direction alignment. Second, we introduce Personalized RL-tuning. Specifically, we construct a personalized Gaussian Mixture Distribution for each user based on their historical interests. By randomly sampling distinct reasoning starting points from this distribution during training, we guide the LLMs to traverse diverse reasoning paths within the latent space, enabling efficient exploration of user's multi-faceted interests. Experiments on multiple datasets show that $LaRec$ significantly outperforms existing baselines with comparable efficiency.

生成推荐隐空间推理大模型应用个性化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。