工业级生成重排序框架,兼顾效率与效果
Dual-Rerank: Fusing Causality and Utility for Industrial Generative Reranking

- 用序列知识蒸馏融合自回归与非自回归模型优势
- 列表级解耦优化使在线强化学习更稳定,提升观看时长
- 适合高并发搜索场景,显著降低延迟并提升用户满意度
快手服务超过4亿日活跃用户,每日处理数亿搜索请求,面对数十亿条短视频库。作为最终决策层,重排序阶段通过优化全页整体效用决定用户体验。传统评分排序方法难以捕捉组合依赖关系,而生成式重排序能直接建模排列概率,表现更优。但在高风险生产环境中部署面临双重挑战:1)结构权衡——自回归(AR)模型虽擅长序列建模但延迟过高;非自回归(NAR)模型高效却无法捕捉依赖;2)优化鸿沟——监督学习难直接优化全页效用,强化学习(RL)在高吞吐数据流中又易不稳定。为此,我们提出Dual-Rerank,统一框架通过序列知识蒸馏弥合结构差异,并采用列表级解耦重排序优化(LDRO)实现稳定在线强化学习。大规模线上A/B测试表明,该方法达到业界最优性能,显著提升用户满意度和观看时长,同时相比AR基线大幅降低推理延迟。
原文摘要 · Abstract (English)
Kuaishou serves over 400 million daily active users, processing hundreds of millions of search queries daily against a repository of tens of billions of short videos. As the final decision layer, the reranking stage determines user experience by optimizing whole-page utility. While traditional score-and-sort methods fail to capture combinatorial dependencies, Generative Reranking offers a superior paradigm by directly modeling the permutation probability. However, deploying Generative Reranking in such a high-stakes environment faces a fundamental dual dilemma: 1) the structural trade-off where Autoregressive (AR) models offer superior Sequential modeling but suffer from prohibitive latency, versus Non-Autoregressive (NAR) models that enable efficiency but lack dependency capturing; 2) the optimization gap where Supervised Learning faces challenges in directly optimizing whole-page utility, while Reinforcement Learning (RL) struggles with instability in high-throughput data streams. To resolve this, we propose Dual-Rerank, a unified framework designed for industrial reranking that bridges the structural gap via Sequential Knowledge Distillation and addresses the optimization gap using List-wise Decoupled Reranking Optimization (LDRO) for stable online RL. Extensive A/B testing on production traffic demonstrates that Dual-Rerank achieves State-of-the-Art performance, significantly improving User satisfaction and Watch Time while drastically reducing inference latency compared to AR baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。