通过重建历史行为,让推荐模型理解用户意图,提升未来预测准确率。
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation
- 用掩码重建历史项目,让模型理解用户行为逻辑。
- 在三个数据集上显著优于现有生成式推荐方法。
- 适合研究生成式推荐与用户行为建模的学者。
生成式推荐直接生成项目标识符,已成为推荐系统的一种有前景范式。然而,其潜力受限于纯自回归训练方式——仅关注下一个项目的预测,忽视用户交互历史的内在结构,难以捕捉真实意图。为此,我们提出掩码历史学习(MHL),一种新型训练框架,将目标从简单下一步预测转变为对历史的深度理解。MHL在标准自回归目标基础上,增加一个辅助任务:重建被掩码的历史项目,迫使模型理解用户行为路径的形成原因,而不仅是预测下一个项目。我们提出两项关键改进:(1) 基于熵的掩码策略,智能选择最具信息量的历史项目进行重建;(2) 课程学习调度器,逐步从历史重建过渡到未来预测。在三个公开数据集上的实验表明,该方法显著优于当前最优生成式推荐模型,验证了全面理解过去对准确预测用户未来路径的关键作用。
原文摘要 · Abstract (English)
Generative recommendation, which directly generates item identifiers, has emerged as a promising paradigm for recommendation systems. However, its potential is fundamentally constrained by the reliance on purely autoregressive training. This approach focuses solely on predicting the next item while ignoring the rich internal structure of a user's interaction history, thus failing to grasp the underlying intent. To address this limitation, we propose Masked History Learning (MHL), a novel training framework that shifts the objective from simple next-step prediction to deep comprehension of history. MHL augments the standard autoregressive objective with an auxiliary task of reconstructing masked historical items, compelling the model to understand ``why'' an item path is formed from the user's past behaviors, rather than just ``what'' item comes next. We introduce two key contributions to enhance this framework: (1) an entropy-guided masking policy that intelligently targets the most informative historical items for reconstruction, and (2) a curriculum learning scheduler that progressively transitions from history reconstruction to future prediction. Experiments on three public datasets show that our method significantly outperforms state-of-the-art generative models, highlighting that a comprehensive understanding of the past is crucial for accurately predicting a user's future path.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。