提出DADF框架,精准修正推荐系统观看时长预测的偏差。
DADF: A Distribution-Aware Debiasing Framework for Watch-Time Regression in Recommender Systems

- 用分组变换和专家路由实现对预测残差的乘法修正
- 在多个数据集上平均降低4.33%的离线MAE,生产环境降12.57%
- 无需替换现有模型,适合工业级推荐系统快速集成
短视频推荐系统中的观看时长预测器虽可大致校准自身评分,但仍存在短时长高估、长时长低估的问题。本文研究这种标签空间均值收缩是否包含可预测的残差结构,且无需替换成熟的第一阶段模型即可修正。提出DADF——一种分布感知的第二阶段纠偏框架,对冻结的观看时长预测器实施乘法修正。DADF通过视频时长路由专用修正专家,利用群体特定变换稳定长尾修正目标,并融合辅助互动表示。视频时长仅用于索引异质残差分布,不视为成因。在KuaiRec和WeChat21数据集上,使用七种第一阶段骨干模型,结合大规模工业排序系统验证,DADF平均降低离线MAE 4.33%,提升XAUC 4.01%。生产环境中MAE下降12.57%。三次全量排序、粗粒度排序及降级服务的在线A/B测试分别带来设备平均观看时长提升0.649%、0.235%和0.199%,全部成功部署至100%流量。结果表明,DADF是可落地、模型无关的插件式纠偏方案,保留了成熟第一阶段模型的推理接口。代码已开源。
原文摘要 · Abstract (English)
Watch-time predictors in short-video recommender systems can be approximately calibrated by their own scores while still overestimating short observations and underestimating long ones. We study whether this label-space mean shrinkage contains inference-time-predictable residual structure that can be corrected without replacing a mature first-stage model. We propose DADF, a distribution-aware second-stage framework that applies multiplicative correction to a frozen watch-time predictor. DADF stabilizes long-tailed correction targets with group-specific transformations, uses video duration to route specialized correction experts, and incorporates auxiliary engagement representations. Duration is used only to index heterogeneous residual distributions, not treated as the cause of the observed pattern. Experiments on KuaiRec and WeChat21 with seven first-stage backbones, together with a large-scale industrial ranking system, show that DADF reduces offline MAE by 4.33% and improves XAUC by 4.01% on average. In production, it reduces MAE by 12.57%. Three online A/B tests across full ranking, rough ranking, and degraded serving improve average time spent per device by 0.649%, 0.235%, and 0.199%, respectively, and all three integrations were subsequently deployed to 100% of traffic. These results show that DADF is a practical, model-agnostic plug-in for correcting predictable conditional residuals while preserving the serving interface of mature first-stage models. Code is available at https://github.com/liuzhao09/DADF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。