arXiv:2502.18965cs.IR2025-02被引 312

用统一生成模型替代传统检索排序,提升推荐系统效果。

OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment

论文配图:OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment
图 1 · 摘自论文原文
  • 采用编码器-解码器结构,结合稀疏专家混合提升模型容量。
  • 通过会话级生成实现更连贯的推荐结果,优于逐项预测。
  • 利用迭代偏好对齐和少量样本优化,显著提升推荐质量。

近期生成式检索推荐系统崭露头角,但多数系统仍采用检索-排序的分步框架,生成模型仅用于筛选阶段。本文提出OneRec,首个端到端生成式推荐模型,在真实场景中超越现有复杂推荐系统。其核心包括:1)基于编码器-解码器结构,编码用户历史行为序列并逐步生成感兴趣视频;采用稀疏专家混合(MoE)在不显著增加计算量的前提下扩展模型容量。2)会话级生成方法,相比依赖人工规则的逐项生成,更具上下文连贯性。3)结合直接偏好优化(DPO)与迭代偏好对齐模块,设计奖励模型模拟用户反馈,定制采样策略。实验表明,少量DPO样本即可有效对齐用户偏好,显著提升生成质量。在快手主场景部署后,观看时长提升1.6%,效果显著。

原文摘要 · Abstract (English)

Recently, generative retrieval-based recommendation systems have emerged as a promising paradigm. However, most modern recommender systems adopt a retrieve-and-rank strategy, where the generative model functions only as a selector during the retrieval stage. In this paper, we propose OneRec, which replaces the cascaded learning framework with a unified generative model. To the best of our knowledge, this is the first end-to-end generative model that significantly surpasses current complex and well-designed recommender systems in real-world scenarios. Specifically, OneRec includes: 1) an encoder-decoder structure, which encodes the user's historical behavior sequences and gradually decodes the videos that the user may be interested in. We adopt sparse Mixture-of-Experts (MoE) to scale model capacity without proportionally increasing computational FLOPs. 2) a session-wise generation approach. In contrast to traditional next-item prediction, we propose a session-wise generation, which is more elegant and contextually coherent than point-by-point generation that relies on hand-crafted rules to properly combine the generated results. 3) an Iterative Preference Alignment module combined with Direct Preference Optimization (DPO) to enhance the quality of the generated results. Unlike DPO in NLP, a recommendation system typically has only one opportunity to display results for each user's browsing request, making it impossible to obtain positive and negative samples simultaneously. To address this limitation, We design a reward model to simulate user generation and customize the sampling strategy. Extensive experiments have demonstrated that a limited number of DPO samples can align user interest preferences and significantly improve the quality of generated results. We deployed OneRec in the main scene of Kuaishou, achieving a 1.6\% increase in watch-time, which is a substantial improvement.

推荐系统生成模型偏好对齐MoE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。