arXiv:2502.10284cs.IRcs.AI2025-02中稿 · WWW 2025被引 8

解决推荐系统预排序阶段的样本偏差问题,提升长尾商品曝光

A Hybrid Cross-Stage Coordination Pre-ranking Model for Online Recommendation Systems

  • 融合上游检索和下游排序的多阶段信息,构建混合样本训练预排序模型
  • 引入新损失函数,使预排序在保持一致性的同时提升长尾商品点击率1.3%
  • 适合追求精准推荐与公平曝光的电商推荐系统应用

大规模推荐系统通常采用级联架构,包含召回、预排序、排序和重排序四个阶段。由于严格的延迟要求,预排序阶段使用轻量级模型从海量候选中进行初步筛选。然而,现有方法仅关注与排序阶段的一致性,依赖下游输入作为学习信号,加剧了样本选择偏差(SSB)和马太效应,导致性能不佳。为此,本文提出一种新型混合跨阶段协同预排序模型(HCCP),通过整合上游(召回)和下游(排序、重排序)的信息,增强预排序对全链路的适应能力。HCCP包含混合样本构建与混合目标优化两部分:前者从全链路未暴露数据中提取多层级信息,重构为预排序学习的最优“真实标签”;后者通过提出的边际InfoNCE损失,联合优化一致性与长尾精度,有效指导模型学习。附录提供了该损失在挖掘潜在正样本方面的有效性证明。大量离线与在线实验表明,HCCP显著优于当前最先进方法,在京东电商推荐系统中实现最高14.9%的UCVR和1.3%的UCTR提升。受限于代码隐私,仅提供参考伪代码。

原文摘要 · Abstract (English)

Large-scale recommendation systems often adopt cascading architecture consisting of retrieval, pre-ranking, ranking, and re-ranking stages. With strict latency requirements, pre-ranking utilizes lightweight models to perform a preliminary selection from massive retrieved candidates. However, recent works focus solely on improving consistency with ranking, relying exclusively on downstream stages. Since downstream input is derived from the pre-ranking output, they will exacerbate the sample selection bias (SSB) issue and Matthew effect, leading to sub-optimal results. To address the limitation, we propose a novel Hybrid Cross-Stage Coordination Pre-ranking model (HCCP) to integrate information from upstream (retrieval) and downstream (ranking, re-ranking) stages. Specifically, cross-stage coordination refers to the pre-ranking's adaptability to the entire stream and the role of serving as a more effective bridge between upstream and downstream. HCCP consists of Hybrid Sample Construction and Hybrid Objective Optimization. Hybrid sample construction captures multi-level unexposed data from the entire stream and rearranges them to become the optimal guiding "ground truth" for pre-ranking learning. Hybrid objective optimization contains the joint optimization of consistency and long-tail precision through our proposed Margin InfoNCE loss. It is specifically designed to learn from such hybrid unexposed samples, improving the overall performance and mitigating the SSB issue. The appendix describes a proof of the efficacy of the proposed loss in selecting potential positives. Extensive offline and online experiments indicate that HCCP outperforms SOTA methods by improving cross-stage coordination. It contributes up to 14.9% UCVR and 1.3% UCTR in the JD E-commerce recommendation system. Concerning code privacy, we provide a pseudocode for reference.

推荐系统预排序长尾推荐跨阶段协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。