用生成-排序框架提升工业级推荐召回,兼顾精准与效率。
GRank: Towards Target-Aware and Streamlined Industrial Retrieval with a Generate-Rank Framework
- 通过目标感知生成器在GPU上加速最近邻搜索,无需维护复杂索引。
- 轻量排名器对候选集进行细粒度打分,召回率提升超30%。
- 端到端训练保证生成与排序语义一致,适合高并发生产环境。
工业级推荐系统依赖级联流水线,检索阶段需在严格延迟约束下从数十亿物品中返回高召回候选集。现有方案或因解耦双塔架构表达能力有限,或因生成模型缺乏精准目标感知匹配能力;或依赖树、图、量化等结构化索引,其以物品为中心的拓扑难以融合动态用户偏好,且构建与维护成本高昂。本文提出GRank,一种无需结构化索引的新型检索范式,无缝融合目标感知学习与用户中心检索。核心创新包括:(1) 目标感知生成器通过GPU加速的MIPS实现个性化候选生成,消除语义漂移与索引维护成本;(2) 轻量但强大的排名器对小规模候选子集执行细粒度、候选特定推理;(3) 端到端多任务学习框架确保生成与排序目标间语义一致性。在两个公开基准与一个十亿级生产数据集上的实验表明,GRank将Recall@500提升超过30%,P99 QPS达现有树与图基检索器的1.7倍。自2025年第二季度起,GRank已在我们的推荐平台全面上线,服务4亿活跃用户,可用性达99.95%。在线A/B测试验证核心参与度指标显著提升,主应用总使用时长增加0.160%,轻量版增加0.165%。
原文摘要 · Abstract (English)
Industrial-scale recommender systems rely on a cascade pipeline in which the retrieval stage must return a high-recall candidate set from billions of items under tight latency. Existing solutions either (i) suffer from limited expressiveness in capturing fine-grained user-item interactions, as seen in decoupled dual-tower architectures that rely on separate encoders, or generative models that lack precise target-aware matching capabilities, or (ii) build structured indices (tree, graph, quantization) whose item-centric topologies struggle to incorporate dynamic user preferences and incur prohibitive construction and maintenance costs. We present GRank, a novel structured-index-free retrieval paradigm that seamlessly unifies target-aware learning with user-centric retrieval. Our key innovations include: (1) A target-aware Generator trained to perform personalized candidate generation via GPU-accelerated MIPS, eliminating semantic drift and maintenance costs of structured indexing; (2) A lightweight but powerful Ranker that performs fine-grained, candidate-specific inference on small subsets; (3) An end-to-end multi-task learning framework that ensures semantic consistency between generation and ranking objectives. Extensive experiments on two public benchmarks and a billion-item production corpus demonstrate that GRank improves Recall@500 by over 30% and 1.7$\times$ the P99 QPS of state-of-the-art tree- and graph-based retrievers. GRank has been fully deployed in production in our recommendation platform since Q2 2025, serving 400 million active users with 99.95% service availability. Online A/B tests confirm significant improvements in core engagement metrics, with Total App Usage Time increasing by 0.160% in the main app and 0.165% in the Lite version.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。