让生成式推荐更高效,用隐空间推理少算一半步骤还更好
LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation

- 用两阶段训练让符号语义与隐空间对齐,解决无预训练语义问题
- 通过双向KL约束防止表示漂移,动态预测每条推荐所需推理步数
- 结合强化学习自适应调整推理深度,比显式生成快20倍
大型语言模型在链式思维(CoT)任务中展现了强大推理能力,但逐令牌生成效率低下,难以部署于对延迟敏感的推荐系统。隐式推理作为新范式,在连续隐状态空间中进行多步推断,可降低成本。然而该方法在主流生成式推荐中仍研究不足。主要挑战包括:(1) 无先验语义的符号标识(SID)与连续隐空间之间存在鸿沟;(2) 缺乏推理链监督导致表征漂移;(3) 固定全局推理深度不优。为此,我们提出LASAR(隐式自适应语义对齐推理)框架,采用SFT-then-RL流程:第一阶段先建立SID语义,第二阶段引入隐式推理,确保高效收敛;第二,通过显式链式思维语义对齐缓解表征漂移,使用分步双向KL散度,以文本推理中的隐藏状态锚点约束隐空间轨迹,并由策略头预测每样本推理步数;第三,在基于GRPO的强化学习阶段,仅终端进行KL对齐以适应变长推理,用REINFORCE优化策略头,实现动态步数分配。实验表明,该方法平均隐式步数几乎减半,同时提升推荐质量。在三个真实数据集上表现最优,推理延迟增加极少,约为显式生成的1/20。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated powerful reasoning capabilities through Chain-of-Thought (CoT) in various tasks, yet the inefficiency of token-by-token generation hinders real-world deployment in latency-sensitive recommender systems. Latent reasoning has emerged as an effective paradigm in LLMs, performing multi-step inference in a continuous hidden-state space to achieve stronger reasoning at lower cost. However, this paradigm remains underexplored in mainstream generative recommendation. Achieving this reveals three key challenges: (1) the gap between prior-less Semantic ID (SID) symbols and continuous latent reasoning, as SIDs lack pre-trained semantics, hindering joint optimization; (2) representation drift due to a lack of reasoning chain supervision; and (3) the suboptimality of applying a globally fixed reasoning depth. To address these, we propose LASAR (Latent Adaptive Semantic Aligned Reasoning), an SFT-then-RL framework. First, we bridge this gap via two-stage training: Stage 1 grounds SID semantics before Stage 2 introduces latent reasoning, ensuring efficient convergence. Second, we mitigate representation drift through explicit CoT semantic alignment. Step-wise bidirectional KL divergence constrains the latent reasoning trajectory using hidden-state anchors extracted from CoT text, while a Policy Head predicts per-sample reasoning depth. Third, during the GRPO-based RL phase, terminal-only KL alignment accommodates variable-length reasoning, and REINFORCE optimizes the Policy Head to dynamically allocate steps. This nearly halves the average latent step count while simultaneously improving recommendation quality. Experiments on three real-world datasets show that LASAR achieves the best overall performance across the evaluated settings. It adds limited inference latency and is roughly 20x faster than generating explicit CoT text.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。