通过量化映射消除视频推荐中的行为偏差,更精准捕捉用户真实兴趣。
AlignPxtr: Aligning Predicted Behavior Distributions for Bias-Free Video Recommendations
- 用分位数映射对齐不同偏差下的行为分布,理论保证偏差与兴趣无关联。
- 同时处理观看时长、点赞等连续与离散行为信号,提升推荐公平性。
- 在快手轻量版和主站实测中,用户活跃天数提升0.267%,使用时长增1.1%。
在视频推荐系统中,观看时长、点赞、关注等用户行为常用于推断兴趣,但受时长偏差、人口统计偏差及内容类别偏差影响,掩盖了真实偏好。本文假设偏差与用户兴趣相互独立,提出一种新方法:通过分位数映射对齐不同偏差条件下的行为预测分布,理论上确保偏差变量与真实兴趣间互信息为零。该方法显式建模不同偏差下用户行为的条件分布,并将行为映射至分位数,有效解耦用户兴趣与各类偏差干扰。该方法可同时处理连续信号(如观看时长)与离散信号(如点赞、评论),并兼顾多重偏差维度。此外,我们设计了一种计算高效的均值对齐替代方案,适用于大规模系统的实时推理。我们在两个主流视频平台——快手轻量版与快手主站上进行在线A/B测试,结果显示,活跃天数分别提升0.267%和0.115%,平均使用时长分别增长1.102%和0.131%。结果表明,该方法在提升长期用户留存和显著增加平均使用时长方面表现稳定且有效。核心代码将公开于https://github.com/justopit/CQE。
原文摘要 · Abstract (English)
In video recommendation systems, user behaviors such as watch time, likes, and follows are commonly used to infer user interest. However, these behaviors are influenced by various biases, including duration bias, demographic biases, and content category biases, which obscure true user preferences. In this paper, we hypothesize that biases and user interest are independent of each other. Based on this assumption, we propose a novel method that aligns predicted behavior distributions across different bias conditions using quantile mapping, theoretically guaranteeing zero mutual information between bias variables and the true user interest. By explicitly modeling the conditional distributions of user behaviors under different biases and mapping these behaviors to quantiles, we effectively decouple user interest from the confounding effects of various biases. Our approach uniquely handles both continuous signals (e.g., watch time) and discrete signals (e.g., likes, comments), while simultaneously addressing multiple bias dimensions. Additionally, we introduce a computationally efficient mean alignment alternative technique for practical real-time inference in large-scale systems. We validate our method through online A/B testing on two major video platforms: Kuaishou Lite and Kuaishou. The results demonstrate significant improvements in user engagement and retention, with \textbf{cumulative lifts of 0.267\% and 0.115\% in active days, and 1.102\% and 0.131\% in average app usage time}, respectively. The results demonstrate that our approach consistently achieves significant improvements in long-term user retention and substantial gains in average app usage time across different platforms. Our core code will be publised at https://github.com/justopit/CQE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。