用扩散模型生成推荐,更准更稳。
Diffusion Language Model for Recommendation

- 基于扩散机制的非自回归推荐,捕捉物品间复杂依赖关系。
- 通过渐进式训练和投票机制,提升推荐一致性与鲁棒性。
- 适合追求高精度、多样性推荐的系统开发者使用。
大语言模型赋能的推荐系统正成为生成式推荐的前沿范式,凭借其强大的语义推理与生成能力,可建模复杂的用户偏好。然而,现有方法多采用自回归范式,其逐词生成方式忽视了用户偏好中的结构性物品依赖关系。前缀约束生成还限制了双向上下文理解,导致早期错误无法修正。受扩散语言模型成功的启发,我们提出DLMRec——一种专为推荐设计的离散扩散语言模型,提供自回归生成的替代方案。具体包括三个关键组件:1)协同感知的随机分词器,将多跳协同信号编码为适配扩散建模的离散标记;2)课程驱动的训练策略,通过逐级物品与标记层面学习,使去噪过程与偏好恢复对齐;3)稳定性感知的投票机制,聚合迭代预测以增强生成一致性和鲁棒性。
原文摘要 · Abstract (English)
Large language model (LLM)-empowered recommender systems have emerged as a promising paradigm for generative recommendation, leveraging their strong semantic reasoning and generative capacity to model complex, diverse user preferences. However, most existing approaches rely on an autoregressive paradigm that is suboptimal for recommendation. The next-token objective emphasizes sequential order rather than the structural inter-item dependencies underlying user preferences. In addition, prefix-constrained generation restricts bidirectional context and commits to left-to-right decoding, causing early errors to accumulate without correction. Inspired by the success of diffusion language models, we propose \textbf{DLMRec}, a discrete diffusion language model tailored for recommendation that offers a compelling alternative to autoregressive generation. Specifically, DLMRec introduces three key components to bridge diffusion language modeling with recommendation. First, a collaborative-aware stochastic tokenizer encodes multi-hop collaborative signals into expressive discrete tokens compatible with diffusion modeling. Second, a curriculum-driven training strategy aligns the denoising process with preference recovery through progressive item- and token-level learning. Third, a stability-aware voting mechanism aggregates iterative predictions to improve generation consistency and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。