用认知不确定性提升冷启动推荐效果,让模型更高效利用训练数据。
Harnessing Light for Cold-Start Recommendations: Leveraging Epistemic Uncertainty to Enhance Performance in User-Item Interactions
- 引入认知不确定性衡量模型对训练知识的使用效率。
- 在多个公开数据集上显著提升冷启动推荐性能。
- 适合关注冷启动问题与模型可信度的推荐系统研究者。
当前基于生成模型的推荐系统仍面临冷启动难题。现有方法多聚焦于获取更多知识以丰富嵌入或输入,但缺乏对模型利用训练知识效率的评估,导致大量知识未被充分使用,限制了冷启动表现的提升。为此,本文提出认知不确定性概念,间接刻画模型对训练知识的利用效率。由于认知不确定性代表可减少的总不确定性部分,可基于此优化推荐模型以进一步提升性能。我们提出了基于认知不确定性的冷启动推荐框架(CREU),并受成对距离估计器(PaiDEs)启发,通过高维空间中模型输出与权重间的互信息来高效准确地测量认知不确定性。在多个公开数据集上的广泛离线实验验证了CREU的优势与鲁棒性。
原文摘要 · Abstract (English)
Most recent paradigms of generative model-based recommendation still face challenges related to the cold-start problem. Existing models addressing cold item recommendations mainly focus on acquiring more knowledge to enrich embeddings or model inputs. However, many models do not assess the efficiency with which they utilize the available training knowledge, leading to the extraction of significant knowledge that is not fully used, thus limiting improvements in cold-start performance. To address this, we introduce the concept of epistemic uncertainty to indirectly define how efficiently a model uses the training knowledge. Since epistemic uncertainty represents the reducible part of the total uncertainty, we can optimize the recommendation model further based on epistemic uncertainty to improve its performance. To this end, we propose a Cold-Start Recommendation based on Epistemic Uncertainty (CREU) framework. Additionally, CREU is inspired by Pairwise-Distance Estimators (PaiDEs) to efficiently and accurately measure epistemic uncertainty by evaluating the mutual information between model outputs and weights in high-dimensional spaces. The proposed method is evaluated through extensive offline experiments on public datasets, which further demonstrate the advantages and robustness of CREU. The source code is available at https://github.com/EsiksonX/CREU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。