arXiv:2605.25749cs.IRcs.AI2026-05KDD被引 1

用密集监督提升推荐重排序,让模型提前规划最优结果。

DeGRe: Dense-supervised Generative Reranking for Recommendation

论文配图:DeGRe: Dense-supervised Generative Reranking for Recommendation
图 1 · 摘自论文原文
  • 离线阶段用累积回归搜索高价值候选序列,生成密集监督信号
  • 在线生成只需一次贪心解码,逼近全局最优
  • 已在淘宝闪购上线,显著提升推荐效果

在多阶段推荐系统中,重排序通过捕捉列表内上下文依赖来优化整体收益,但核心挑战在于从指数级庞大的排列空间中探索最优序列。现有端到端生成框架通常依赖列表级奖励或偏好对齐指导生成器训练,但仍存在两大问题:一是启发式标签偏差,训练目标常基于简单规则(如将点击项置顶),忽视列表内部的因果依赖;二是信用分配难题,稀疏的列表级后验奖励无法有效指导序列生成的中间步骤,导致优化方向模糊。为此,我们提出DeGRe(Dense-supervised Generative Reranking),一种通过密集监督连接离线探索与在线效率的生成重排序框架。其核心为离线-在线解耦设计:离线阶段引入基于累积回归的前瞻评估器,利用束搜索主动挖掘未暴露空间中的高价值前瞻序列;训练时将评估器输出的逐步价值估计转化为密集监督信号,并蒸馏至轻量级在线生成器。该机制使生成器内化前瞻规划能力,线上推理仅需一次高效贪心解码即可逼近全局最优。实验表明,DeGRe在公开基准和工业数据集上均优于基线模型,并已在淘宝闪购成功部署,显著提升在线推荐表现。

原文摘要 · Abstract (English)

In multi-stage recommender systems, reranking optimizes overall utility by capturing intra-list contextual dependencies, yet its central challenge lies in exploring optimal sequences within an exponentially large permutation space. Recent studies have shifted towards end-to-end generative frameworks, which typically leverage list-wise rewards or preference alignment to guide generator training. However, these methods still face two critical issues. First is the heuristic label bias. Existing methods often construct training targets based on simple rules, such as promoting clicked items to the top, while ignoring causal dependencies within the list context. Second is the credit assignment problem. Sparse list-level posterior rewards fail to directly guide intermediate steps in sequence generation, leading to ambiguous optimization directions. To address these issues, we propose DeGRe (Dense-supervised Generative Reranking), a generative reranking framework that bridges the gap between offline exploration and online efficiency through dense supervision. The core of DeGRe lies in its offline-online decoupled design. During the offline phase, we introduce a Lookahead Evaluator based on cumulative regression, which leverages beam search to actively mine high-value lookahead sequences in the unexposed space. During training, we transform the step-wise value estimations from the evaluator into dense supervision signals and distill them into a lightweight Online Generator. This mechanism enables the generator to internalize lookahead planning capabilities, requiring only a single efficient greedy decoding pass during online inference to approximate the global optimum. Experiments demonstrate that DeGRe outperforms baseline models on public benchmarks and industrial datasets. We have successfully deployed DeGRe on Taobao Flash Shopping, significantly improving online recommendations.

推荐系统生成重排序密集监督在线推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。