用全局标识符生成取代局部索引选择,提升推荐系统重排序效果
From Local Indices to Global Identifiers: Generative Reranking for Recommender Systems via Global Action Space
- 将重排序转为生成离散标记的序列任务,实现统一评估标准
- 在两个公开数据集和工业数据集上均显著优于现有方法
- 适合需要稳定冷启动表现的推荐系统场景
现代推荐系统中的列表级重排序是多阶段流程的关键环节,通过建模列表内项目间的复杂依赖关系直接影响用户满意度。现有方法通常将此任务表述为从局部输入列表中选择索引,但该方式存在语义不一致的动作空间:同一输出神经元(logits)在不同样本中代表不同项目,导致模型难以建立对项目的稳定内在理解。为此,我们提出GloRank(Global Action Space Ranker),一种生成式框架,将重排序从选择局部索引转变为生成全局标识符。具体而言,我们将项目表示为离散标记序列,并将重排序重构为标记生成任务。该设计有效解耦了评分机制与可变输入顺序,确保项目始终基于一致的全局标准进行评估。我们进一步引入两阶段优化流程:首先通过监督预训练初始化模型以获得高质量示范,再通过强化学习后训练直接最大化列表级效用。在两个公开基准和一个大规模工业数据集上的大量实验,以及线上A/B测试表明,GloRank持续优于当前最先进基线,在冷启动场景下展现出更优鲁棒性。
原文摘要 · Abstract (English)
In modern recommender systems, list-wise reranking serves as a critical phase within the multi-stage pipeline, finalizing the exposed item sequence and directly impacting user satisfaction by modeling complex intra-list item dependencies. Existing methods typically formulate this task as selecting indices from the local input list. However, this approach suffers from a semantically inconsistent action space: the same output neuron (logits) represents different items across different samples, preventing the model from establishing a stable, intrinsic understanding of the items. To address this, we propose GloRank (Global Action Space Ranker), a generative framework that shifts reranking from selecting local indices to generating global identifiers. Specifically, we represent items as sequences of discrete tokens and reformulate reranking as a token generation task. This design effectively decouples the scoring mechanism from the variable input order, ensuring that items are evaluated against a consistent global standard. We further enhance this with a two-stage optimization pipeline: a supervised pre-training phase to initialize the model with high-quality demonstrations, followed by a reinforcement learning-based post-training phase to directly maximize list-wise utility. Extensive experiments on two public benchmarks and a large-scale industrial dataset, coupled with online A/B tests, demonstrate that GloRank consistently outperforms state-of-the-art baselines and achieves superior robustness in cold-start scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。