用贝叶斯集成学习提升推荐系统的不确定性感知能力。
Epistemic Uncertainty-aware Recommendation Systems via Bayesian Deep Ensemble Learning
- 基于贝叶斯神经网络与集成学习,显式建模权重不确定性。
- 在多个真实数据集上,相较基线模型显著提升推荐准确率。
- 适合需要可解释性与鲁棒预测的推荐场景。
推荐系统长期面临用户-物品匹配任务,现有方法多依赖表示学习将用户与物品映射至统一嵌入空间。然而,在显式反馈与稀疏数据场景下,主流模型存在过拟合风险且缺乏对认知不确定性(epistemic uncertainty)的建模。为此,本文提出一种新型贝叶斯深度集成协同过滤方法BDECF。通过引入贝叶斯神经网络,使模型在权重参数中隐含不确定性;设计基于注意力机制的非线性匹配方式以增强表达能力;并采用集成超模型结构提升预测鲁棒性。在多个公开真实数据集上的广泛实验与消融研究验证了该方法的有效性及各模块的重要性。
原文摘要 · Abstract (English)
Recommending items to users has long been a fundamental task, and studies have tried to improve it ever since. Most well-known models commonly employ representation learning to map users and items into a unified embedding space for matching assessment. These approaches have primary limitations, especially when dealing with explicit feedback and sparse data contexts. Two primary limitations are their proneness to overfitting and failure to incorporate epistemic uncertainty in predictions. To address these problems, we propose a novel Bayesian Deep Ensemble Collaborative Filtering method named BDECF. To improve model generalization and quality, we utilize Bayesian Neural Networks, which incorporate uncertainty within their weight parameters. In addition, we introduce a new interpretable non-linear matching approach for the user and item embeddings, leveraging the advantages of the attention mechanism. Furthermore, we endorse the implementation of an ensemble-based supermodel to generate more robust and reliable predictions, resulting in a more complete model. Empirical evaluation through extensive experiments and ablation studies across a range of publicly accessible real-world datasets with differing sparsity characteristics confirms our proposed method's effectiveness and the importance of its components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。