arXiv:2504.16524cs.IR2025-04被引 1

根据模态可靠性自动学习加权,提升多模态推荐准确率

Modality Reliability Guided Multimodal Recommendation

  • 用BPR目标差异定义模态可靠性,作为权重学习的监督信号
  • 在三个真实数据集上,推荐准确率显著优于基线方法
  • 适合处理模态数据质量不一的推荐场景

多模态推荐常面临单一模态方法表现更优的问题,原因可能是不可靠的模态数据损害了融合效果。现有方法虽引入模态权重以降低不可靠模态的影响,但缺乏有效监督导致权重学习不精准。为此,本文提出一种基于模态可靠性的多模态推荐框架,通过BPR推荐目标自动识别模态可靠性:以模态特定用户对正负样本评分的差异作为可靠性向量,差异越大表示该模态越可靠。为进一步增强监督效果,计算可靠性向量的置信度,动态调整监督强度并剔除有害监督。在三个真实数据集上的实验表明,该方法显著优于现有基线。

原文摘要 · Abstract (English)

Multimodal recommendation faces an issue of the performance degradation that the uni-modal recommendation sometimes achieves the better performance. A possible reason is that the unreliable item modality data hurts the fusion result. Several existing studies have introduced weights for different modalities to reduce the contribution of the unreliable modality data in predicting the final user rating. However, they fail to provide appropriate supervisions for learning the modality weights, making the learned weights imprecise. Therefore, we propose a modality reliability guided multimodal recommendation framework that uniquely learns the modality weights supervised by the modality reliability. Considering that there is no explicit label provided for modality reliability, we resort to automatically identify it through the BPR recommendation objective. In particular, we define a modality reliability vector as the supervision label by the difference between modality-specific user ratings to positive and negative items, where a larger difference indicates a higher reliability of the modality as the BPR objective is better satisfied. Furthermore, to enhance the effectiveness of the supervision, we calculate the confidence level for the modality reliability vector, which dynamically adjusts the supervision strength and eliminates the harmful supervision. Extensive experiments on three real-world datasets show the effectiveness of the proposed method.

多模态推荐可靠性建模BPR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。