让推荐系统像人一样思考,逐步推理提升个性化推荐效果。
Slow Thinking for Sequential Recommendation
- 引入多步推理机制,模拟人类慢思考过程。
- 在多个数据集上显著超越传统单步推荐模型。
- 适合需要高精度推荐的场景,如电商与内容平台。
为构建高效的序列化推荐系统,现有方法普遍采用快速思维范式:将用户历史行为编码为表示向量,直接匹配候选物品。然而,由于传统轻量级模型容量有限,这种一步推理常导致性能不佳。为此,本文提出一种新型慢思考推荐模型STREAM-Rec,能够对历史行为进行多步、审慎的推理分析,最终生成个性化推荐。针对两个关键挑战——识别合适的推理模式,以及激发传统推荐器的推理能力——我们设计三阶段训练框架:第一阶段在大规模行为数据上预训练,学习行为模式并捕捉长程依赖;第二阶段通过迭代推理算法逐步优化预测,生成推理轨迹标注数据,并用于模型微调;第三阶段采用强化学习进一步提升模型泛化能力。大量实验验证了该方法的有效性。
原文摘要 · Abstract (English)
To develop effective sequential recommender systems, numerous methods have been proposed to model historical user behaviors. Despite the effectiveness, these methods share the same fast thinking paradigm. That is, for making recommendations, these methods typically encodes user historical interactions to obtain user representations and directly match these representations with candidate item representations. However, due to the limited capacity of traditional lightweight recommendation models, this one-step inference paradigm often leads to suboptimal performance. To tackle this issue, we present a novel slow thinking recommendation model, named STREAM-Rec. Our approach is capable of analyzing historical user behavior, generating a multi-step, deliberative reasoning process, and ultimately delivering personalized recommendations. In particular, we focus on two key challenges: (1) identifying the suitable reasoning patterns in recommender systems, and (2) exploring how to effectively stimulate the reasoning capabilities of traditional recommenders. To this end, we introduce a three-stage training framework. In the first stage, the model is pretrained on large-scale user behavior data to learn behavior patterns and capture long-range dependencies. In the second stage, we design an iterative inference algorithm to annotate suitable reasoning traces by progressively refining the model predictions. This annotated data is then used to fine-tune the model. Finally, in the third stage, we apply reinforcement learning to further enhance the model generalization ability. Extensive experiments validate the effectiveness of our proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。