用扩散模型模拟人类思考,分步生成推荐,效果更优。
MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation
- 用扩散机制分步生成推荐,先抓关键特征再细化
- 在多个数据集上提升9.5%的准确率,超越现有方法
- 适合想改进推荐系统生成质量的研究者和工程师
基于大语言模型的推荐系统通常将物品表示为文本或语义ID,采用自回归方式生成推荐。但这种从左到右的贪婪解码策略与单向逻辑流,难以产生全局最优结果。相比之下,人类推理不遵循固定顺序,常从关键词或直觉出发,逐步完善。受此启发,我们提出MindRec,一种基于扩散模型的粗粒度到细粒度生成范式,模仿人类思维过程。该方法利用掩码扩散过程重构物品,摆脱自回归限制,实现灵活、非序列化生成。首先生成反映用户偏好的关键标记,再扩展为完整物品,支持自适应的人类式生成。为进一步模拟人类决策的结构化特点,我们将物品组织成层次化类别树,引导模型先生成粗粒度类别,再逐层细化至子类别,最终生成具体物品。为缓解贪婪解码导致的局部最优问题,我们设计了专为该范式定制的扩散束搜索算法(Diffusion Beam Search)。实验表明,MindRec在多个基准数据集上平均提升9.5%的Top-1准确率,显著优于当前最先进方法。代码已开源:https://github.com/Mr-Peach0301/MindRec。
原文摘要 · Abstract (English)
Recent advancements in large language model-based recommendation systems often represent items as text or semantic IDs and generate recommendations in an auto-regressive manner. However, due to the left-to-right greedy decoding strategy and the unidirectional logical flow, such methods often fail to produce globally optimal recommendations. In contrast, human reasoning does not follow a rigid left-to-right sequence. Instead, it often begins with keywords or intuitive insights, which are then refined and expanded. Inspired by this fact, we propose MindRec, a diffusion-driven coarse-to-fine generative paradigm that emulates human thought processes. Built upon a diffusion language model, MindRec departs from auto-regressive generation by leveraging a masked diffusion process to reconstruct items in a flexible, non-sequential manner. Particularly, our method first generates key tokens that reflect user preferences, and then expands them into the complete item, enabling adaptive and human-like generation. To further emulate the structured nature of human decision-making, we organize items into a hierarchical category tree. This structure guides the model to first produce the coarse-grained category and then progressively refine its selection through finer-grained subcategories before generating the specific item. To mitigate the local optimum problem inherent in greedy decoding, we design a novel beam search algorithm, Diffusion Beam Search, tailored for our mind-inspired generation paradigm. Experimental results demonstrate that MindRec yields a 9.5\% average improvement in top-1 accuracy over state-of-the-art methods, highlighting its potential to enhance recommendation performance. The implementation is available via https://github.com/Mr-Peach0301/MindRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。