解决视频推荐中用户偏好预测噪声对排序的双重干扰问题
DrEM: Dual-Side Robust Ensemble Ranking from Noisy User Preference Predictions in Video Recommendation

- 双侧鲁棒框架:同时处理噪声偏好标签和噪声输入特征
- 引入噪声翻转概率估计,降低错误梯度影响,提升排序稳定性
- 工业级线上测试验证有效,适合高噪声真实场景下的推荐系统
工业级视频推荐系统通常采用多阶段架构。在集成排序阶段,上游多任务模型生成的多维用户偏好预测(pxtrs)被融合为统一排序分数以反映用户满意度。由于用户真实满意度难以直接观测,现有方法常将pxtrs既作为输入特征,又用于构建代理偏好。然而,作为上游预测模型的输出,pxtrs不可避免地包含预测噪声,这种噪声会从两个层面传播至下游学习:在监督层面,噪声可能导致代理偏好翻转,引入错误梯度;在特征层面,噪声会通过输入传播,破坏排序分数的稳定性。现有集成排序方法通常将pxtrs视为可靠信号,忽视了此类噪声。为此,本文提出DrEM,一种双侧鲁棒集成排序框架。DrEM引入风险去噪鲁棒损失,基于估计的偏好翻转概率修正经验风险;同时,从预测噪声分布中采样扰动,设计偏好保持的排序一致性正则项,提升特征侧输出稳定性。理论上,我们推导出预测噪声的近似分布,并证明该鲁棒损失在翻转概率估计误差下仍具优势。大量离线实验与大规模线上A/B测试表明,DrEM在效果与鲁棒性上均显著优于基线。
原文摘要 · Abstract (English)
Industrial video recommendation systems typically adopt a multi-stage architecture. At the ensemble ranking stage, multi-dimensional user preference predictions (pxtrs) from an upstream multi-task model are fused into a unified ranking score to reflect user satisfaction. Since users' true satisfaction is difficult to observe directly, ensemble ranking models commonly use pxtrs both as input features and as a source for constructing proxy preferences. However, as outputs of an upstream prediction model, pxtrs inevitably contain prediction noise, which propagates to downstream learning across two sides. On the supervision side, noisy pxtrs may flip proxy preferences and introduce erroneous gradients. On the feature side, pxtr noise may propagate through model inputs and destabilize ranking scores. Existing ensemble ranking methods typically treat pxtrs as reliable signals and overlook such prediction noise. To address this, we propose DrEM, a dual-side robust ensemble ranking framework. Our DrEM introduces a risk-denoising robust loss that corrects the empirical risk using estimated preference flip probability. Meanwhile, it samples perturbations from the distribution of prediction noise and introduces a preference-preserving ranking consistency regularizer to improve feature-side output stability. Theoretically, we obtain an approximate distribution of the prediction noise and prove that the robust loss remains superior under flip probability estimation error. Extensive offline experiments and large-scale online A/B tests demonstrate the effectiveness and robustness of our DrEM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。