用成对生成提升推荐系统速度与质量,支持高效长序列重排序。
PSG: Pair-Space Generation for Efficient Generative Reranking
- 将生成单位从单个物品改为有序成对,减少生成次数
- 理论与实测均显示速度提升1.83至4倍,延迟显著降低
- 适合高并发、低延迟场景,如大型短视频平台推荐
现代推荐系统采用生成-评估框架进行列表级重排序:生成器从候选集生成序列,评估器以序列级评分筛选最优结果。自回归模型作为生成推荐核心,存在两大局限:生成复杂度随列表长度线性增长,在严苛延迟约束下被迫减少生成数量,限制探索;教师强制导致训练-测试不一致,累积误差随长度加剧,影响质量。为此,我们提出成对空间生成(PSG),将生成原子从单个物品升级为有序物品对。给定n个候选物品,PSG在每请求下操作大小为n(n-1)的成对词汇表,仅生成L/2个标记。成对标记表示由预训练模块实时生成,基于大规模曝光日志优化,缓解了二次方词汇表的数据稀疏问题。我们建立三项理论保证:(i) PSG与物品空间生成双射,诱导等价序列分布族,表达能力无损失;(ii) 在中等设置下理论上实现约2×至4×加速,工业实际环境达1.83×;(iii) 在仅基于结果奖励下,最坏情况次优性被控制在O((L/2)²ε̄),相比物品空间生成近似提升4倍。除基准验证外,该方法已在快手部署,使平台超4亿日活用户的人均停留时长提升0.178%。
原文摘要 · Abstract (English)
Modern recommender systems adopt Generator-Evaluator (G-E) for list-wise reranking: a generator produces sequences from candidates and an evaluator scores them at sequence-level to filter out the optimal one for exposure. Auto-Regressive(AR), working as the backbone for generative recommendation, suffers two limitations. First, its complexity grows linearly with list length, forcing the system to generate fewer lists under rigorous latency constraints and thus limiting exploration. Second, teacher-forcing creates a train-test mismatch; cumulative errors worsen with length and degrade quality. To address these problems, we propose Pair-Space Generation (PSG), a reformulation that elevates the generation atom from individual items to ordered item pairs. Given $n$ candidate items, PSG operates over pair vocabulary of size $n(n-1)$ per request, generates only $L/2$ tokens. Pair token representations are produced on-the-fly by a pretrained pair-token representation module optimized over large scale exposure logs, eliminating the data sparsity that would otherwise plague a quadratic sized vocabulary. We establish three theoretical guarantees: (i) PSG is bijective with item-space generation and induces an equivalent family of sequence distributions, thus incurring no loss of expressiveness; (ii) generation in pair-token space achieves approximately a $2\times$ to $4\times$ speedup theoretically under moderate settings and $1.83\times$ in the real industrial environmental settings; and (iii) under outcome-only rewards, the worst-case suboptimality of PSG is bounded by $O((L/2)^2 \barε)$, representing a nearly $4\times$ improvement over item-space generation. Beyond benchmark-based validation, PSG has also been deployed on Kuaishou, delivering a 0.178\% lift in per-user stay time on the platform, which serves over 400 million daily active users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。