arXiv:2602.09744cs.IR2026-02被引 1

用扩散模型优化用户意图推理,提升推荐准确率

DiffuReason: Bridging Latent Reasoning and Generative Refinement for Sequential Recommendation

论文配图:DiffuReason: Bridging Latent Reasoning and Generative Refinement for Sequential Recommendation
图 1 · 摘自论文原文
  • 引入思维令牌与扩散过程,逐步净化用户意图表示
  • 在4个数据集上超越多种基线模型,线上测试显著提升效果
  • 适合关注推荐系统可解释性与精度的工业研究者

隐式推理已成为序列推荐的前沿范式,通过多步推理解析复杂用户意图。然而现有方法依赖确定性隐式链,噪声累积严重且忽略意图不确定性,同时采用分阶段训练难以联合优化。为此,我们提出DiffuReason,一种统一的“思考-扩散”框架。在思考阶段,模型生成思维令牌,基于用户历史形成初始意图假设;在扩散阶段,不直接输出假设,而是通过扩散过程将其建模为概率分布,实现对推理噪声的迭代去噪;最后,基于群体相对策略优化(GRPO)的强化学习,使推理与精炼模块在端到端训练中协同演化,摆脱分阶段优化限制。大量实验表明,DiffuReason在四个基准数据集上持续提升多种骨干模型性能,大规模工业平台的A/B测试进一步验证其实际有效性。

原文摘要 · Abstract (English)

Latent reasoning has emerged as a promising paradigm for sequential recommendation, enabling models to capture complex user intent through multi-step deliberation. Yet existing approaches often rely on deterministic latent chains that accumulate noise and overlook the uncertainty inherent in user intent, and they are typically trained in staged pipelines that hinder joint optimization and exploration. To address these challenges, we propose DiffuReason, a unified "Think-then-Diffuse" framework for sequential recommendation. It integrates multi-step Thinking Tokens for latent reasoning, diffusion-based refinement for denoising intermediate representations, and end-to-end Group Relative Policy Optimization (GRPO) alignment to optimize for ranking performance. In the Think stage, the model generates Thinking Tokens that reason over user history to form an initial intent hypothesis. In the Diffuse stage, rather than treating this hypothesis as the final output, we refine it through a diffusion process that models user intent as a probabilistic distribution, providing iterative denoising against reasoning noise. Finally, GRPO-based reinforcement learning enables the reasoning and refinement modules to co-evolve throughout training, without the constraints of staged optimization. Extensive experiments on four benchmarks demonstrate that DiffuReason consistently improves diverse backbone architectures. Online A/B tests on a large-scale industrial platform further validate its practical effectiveness.

序列推荐扩散模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。