用少量无偏数据实时平衡推荐系统偏差,提升长期用户兴趣多样性。
ConAlign: Conditional Alignment Framework for Balancing Biased and Unbiased Recommendation

- 通过离散门控机制选择性迁移偏见塔知识到无偏塔。
- 在线测试显示用户兴趣多样性显著提升,延迟几乎不变。
- 首个在大规模工业系统中落地的流式去偏推荐框架。
工业推荐系统基于观察数据训练时存在多种偏差,导致信息茧房,用户兴趣趋于狭窄,严重降低长期参与度。尽管利用无偏均匀数据进行去偏已展现潜力,但现有方法因忽视真实推荐性能或计算开销过大,难以部署。为此,我们提出ConAlign(条件对齐框架),一种面向工业部署的条件去偏方法。其核心创新在于基于离散门控的条件对齐机制,可选择性地将偏见塔的知识传递至无偏塔。不同于普遍修正,该方法遵循选择性干预范式,无缝平衡真实准确性和无偏偏好估计,支持实时流式适配。据我们所知,ConAlign是首个成功部署于大规模工业推荐系统的流式去偏框架,仅使用少量无偏随机流量进行去偏。在三个真实数据集上的离线实验充分验证了其有效性。此外,在快手的大规模在线A/B测试中,显著提升了长期用户参与度与兴趣多样性,且延迟开销可忽略不计。
原文摘要 · Abstract (English)
Industry recommender systems trained on observational data suffer from various biases that create filter bubbles, causing user interests to collapse into narrow categories and severely degrading long-term engagement. While utilizing unbiased uniform data for debiasing has shown promise, existing methods remain impractical for industrial deployment due to limitations such as neglect of factual (biased) recommendation performance and the substantial computational overhead. To overcome these limitations, we propose ConAlign (Conditional Alignment Framework), a conditional debiasing approach for industrial deployment. The key innovation of ConAlign lies in a discrete gating-based conditional alignment mechanism that selectively transfers knowledge from the biased tower to the unbiased tower. Following a selective intervention paradigm rather than universal correction, it seamlessly balances factual accuracy and unbiased preference estimation while supporting real-time streaming adaptation. To the best of our knowledge, ConAlign is the first streaming debiasing recommendation framework successfully deployed in a large-scale industrial recommendation system that utilizes a small fraction of unbiased random traffic for debiasing. Extensive offline experiments on three real-world datasets rigorously validate the effectiveness of our proposed framework. Furthermore, large-scale online A/B testing on Kuaishou demonstrates significant improvements in long-term user engagement and interest diversity, with negligible latency overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。