提出BPL框架,让推荐系统在真实和模拟场景下都表现更好。
BPL: Bias-adaptive Preference Distillation Learning for Recommender System
- 用双蒸馏策略逐步挖掘用户真实偏好
- 在真实交互和随机曝光测试中均显著提升效果
- 适合需要兼顾长期满意度与短期行为预测的推荐场景
推荐系统因数据偏差导致反馈无法完整揭示用户偏好。现有去偏方法多聚焦于随机曝光的反事实测试环境,但在基于真实用户-物品交互的事实测试环境中性能大幅下降。事实上,反事实环境强调长期用户满意度,而事实环境关注平台上的后续行为预测。因此,亟需一种在两类测试中均表现优异的模型。本文提出偏差自适应偏好蒸馏学习(BPL)框架,采用双蒸馏策略:通过有偏模型引导的师生蒸馏保留与收集反馈一致的偏好知识,提升事实测试表现;通过带可靠性过滤的自蒸馏迭代优化模型,增强对多样化用户-物品组合的预测能力,改善反事实测试表现。大量实验验证了BPL在两类测试中的有效性。
原文摘要 · Abstract (English)
Recommender systems suffer from biases that cause the collected feedback to incompletely reveal user preference. While debiasing learning has been extensively studied, they mostly focused on the specialized (called counterfactual) test environment simulated by random exposure of items, significantly degrading accuracy in the typical (called factual) test environment based on actual user-item interactions. In fact, each test environment highlights the benefit of a different aspect: the counterfactual test emphasizes user satisfaction in the long-terms, while the factual test focuses on predicting subsequent user behaviors on platforms. Therefore, it is desirable to have a model that performs well on both tests rather than only one. In this work, we introduce a new learning framework, called Bias-adaptive Preference distillation Learning (BPL), to gradually uncover user preferences with dual distillation strategies. These distillation strategies are designed to drive high performance in both factual and counterfactual test environments. Employing a specialized form of teacher-student distillation from a biased model, BPL retains accurate preference knowledge aligned with the collected feedback, leading to high performance in the factual test. Furthermore, through self-distillation with reliability filtering, BPL iteratively refines its knowledge throughout the training process. This enables the model to produce more accurate predictions across a broader range of user-item combinations, thereby improving performance in the counterfactual test. Comprehensive experiments validate the effectiveness of BPL in both factual and counterfactual tests. Our implementation is accessible via: https://github.com/SeongKu-Kang/BPL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。