arXiv:2510.25220cs.IRcs.AI2025-10中稿 · CIKM 2025被引 9

提出GReF框架,用统一生成法高效重排序,兼顾效果与实时性。

GReF: A Unified Generative Framework for Efficient Reranking via Ordered Multi-token Prediction

  • 用双向编码器+动态自回归解码器生成有序推荐序列
  • 通过OMTP一次预测多个项目,推理延迟接近非自回归模型
  • 端到端训练提升效果,已在3亿日活应用中验证

在多阶段推荐系统中,重排序对建模列表内项目相关性至关重要。核心挑战在于探索排列组合空间中的最优序列。现有方法采用生成-评估两阶段范式:生成器产生多个可行序列,评估器选出最优。实践中生成器常为自回归模型,但存在两大问题:生成与评估分离阻碍端到端训练;自回归生成推理效率低。为此,本文提出统一生成式高效重排序框架GReF。设计Gen-Reranker,采用双向编码器和动态自回归解码器生成因果重排序序列,并在项目曝光顺序上预训练以获得高质量初始化。为消除评估器并实现训练时的序列级评估,提出通过Rerank-DPO进行后训练。为提升自回归推理效率,引入有序多标记预测(OMTP),使模型可同时生成多个未来项目且保持顺序,支持实时推荐系统部署。大量离线实验表明,GReF优于当前最优重排序方法,同时延迟接近非自回归模型。此外,该框架已成功部署于拥有超过3亿日活跃用户的快手视频应用,显著提升在线推荐质量。

原文摘要 · Abstract (English)

In a multi-stage recommendation system, reranking plays a crucial role in modeling intra-list correlations among items. A key challenge lies in exploring optimal sequences within the combinatorial space of permutations. Recent research follows a two-stage (generator-evaluator) paradigm, where a generator produces multiple feasible sequences, and an evaluator selects the best one. In practice, the generator is typically implemented as an autoregressive model. However, these two-stage methods face two main challenges. First, the separation of the generator and evaluator hinders end-to-end training. Second, autoregressive generators suffer from inference efficiency. In this work, we propose a Unified Generative Efficient Reranking Framework (GReF) to address the two primary challenges. Specifically, we introduce Gen-Reranker, an autoregressive generator featuring a bidirectional encoder and a dynamic autoregressive decoder to generate causal reranking sequences. Subsequently, we pre-train Gen-Reranker on the item exposure order for high-quality parameter initialization. To eliminate the need for the evaluator while integrating sequence-level evaluation during training for end-to-end optimization, we propose post-training the model through Rerank-DPO. Moreover, for efficient autoregressive inference, we introduce ordered multi-token prediction (OMTP), which trains Gen-Reranker to simultaneously generate multiple future items while preserving their order, ensuring practical deployment in real-time recommender systems. Extensive offline experiments demonstrate that GReF outperforms state-of-the-art reranking methods while achieving latency that is nearly comparable to non-autoregressive models. Additionally, GReF has also been deployed in a real-world video app Kuaishou with over 300 million daily active users, significantly improving online recommendation quality.

推荐系统重排序生成模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。