arXiv:2510.24369cs.IR2025-10

DUET通过双模型协同训练,提升推荐系统预排序的精准度与多样性。

DUET: Dual Model Co-Training for Entire Space CTR Prediction

  • 采用集合级预测,在单次前向传播中实现候选集间信息交互。
  • 双模型协同优化,有效缓解样本选择偏差,提升未曝光内容的预测能力。
  • 已在快手主应用部署,服务数亿用户,显著提升核心业务指标。

预排序阶段在大规模推荐系统中至关重要,但面临模型表达能力与计算效率之间的固有矛盾。由于候选集庞大且延迟要求严格,工业系统常采用轻量级双塔架构,虽计算高效,但估计能力受限,难以捕捉候选项间的复杂协同与抑制关系,影响推荐列表的上下文一致性和多样性。此外,这种简化加剧了样本选择偏差(SSB)问题,因粗粒度模型在有偏曝光数据上训练,需泛化至分布不同的更大候选空间。为此,我们提出DUET(Dual Model Co-Training for Entire Space CTR Prediction),一种集合级预排序框架,在严格计算预算下实现高表达力建模。不同于独立打分,DUET在单次前向传播中对整个候选子集进行集合级预测,实现候选项间信息感知的交互,并将计算成本分摊到整个集合。同时,双模型协同训练机制通过相互伪标签精炼,将监督扩展至未曝光项,有效缓解SSB。经大量离线实验与线上A/B测试验证,DUET持续优于现有先进基线,在多个核心业务指标上取得提升。目前,DUET已全面部署于快手及快手极速版应用,服务于数亿用户的主要流量。

原文摘要 · Abstract (English)

The pre-ranking stage plays a pivotal role in large-scale recommender systems but faces an intrinsic trade-off between model expressiveness and computational efficiency. Owing to the massive candidate pool and strict latency constraints, industry systems often rely on lightweight two-tower architectures, which are computationally efficient yet limited in estimation capability. As a result, they struggle to capture the complex synergistic and suppressive relationships among candidate items, which are essential for producing contextually coherent and diverse recommendation lists. Moreover, this simplicity further amplifies the Sample Selection Bias (SSB) problem, as coarse-grained models trained on biased exposure data must generalize to a much larger candidate space with distinct distributions. To address these issues, we propose \textbf{DUET} (\textbf{DU}al Model Co-Training for \textbf{E}ntire Space C\textbf{T}R Prediction), a set-wise pre-ranking framework that achieves expressive modeling under tight computational budgets. Instead of scoring items independently, DUET performs set-level prediction over the entire candidate subset in a single forward pass, enabling information-aware interactions among candidates while amortizing the computational cost across the set. Moreover, a dual model co-training mechanism extends supervision to unexposed items via mutual pseudo-label refinement, effectively mitigating SSB. Validated through extensive offline experiments and online A/B testing, DUET consistently outperforms state-of-the-art baselines and achieves improvements across multiple core business metrics. At present, DUET has been fully deployed in Kuaishou and Kuaishou Lite Apps, serving the main traffic for hundreds of millions of users.

推荐系统预排序双塔模型样本偏差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。