通过信息引导筛选关键模态,提升推荐精准度
Information-Guided Selective Modality-Interest Alignment for Multimodal Recommendation

- 基于信息论思想,动态筛选与用户兴趣相关的模态信号
- 在三个真实数据集上优于现有方法,推荐效果显著提升
- 适合需要精准融合多源内容的推荐系统研究者
多模态推荐(MMRec)通过融合图像、文本等多源内容提升推荐性能。然而,直接使用全部模态信息未必有效,因用户兴趣通常只与部分模态相关,其余信号可能弱相关甚至引入噪声。尽管现有方法采用不变学习、注意力机制、图优化或对比学习来改善模态利用,其对齐过程常为隐式或启发式,缺乏明确目标选择更匹配用户兴趣的模态信号。本文提出AMUR框架,基于信息论视角,旨在增强与用户兴趣相关模态信息,抑制不相关信号影响。具体而言,先构建面向用户行为的模态图结构,再选择性对齐跨模态中与兴趣相关语义,从而提升模态-兴趣对齐度,同时保留模态特有互补信息。在三个真实世界数据集上的大量实验表明,AMUR显著优于多个基线模型。代码已开源:https://github.com/Wenze1/AMUR。
原文摘要 · Abstract (English)
Multimodal recommendation (MMRec) aims to enhance recommendation performance by leveraging rich item content from multiple modalities. However, directly incorporating all modality information does not necessarily lead to better preference modeling, since user interests are often more related to a subset of modality signals, while other signals may be weakly aligned with user preferences or even introduce noise. Although recent MMRec methods improve modality utilization through invariant learning, attention mechanisms, graph refinement, or contrastive learning, their alignment processes are often implicit or heuristic and lack a clear objective for selecting modality signals that better match user interests. In this paper, we propose AMUR, an information-guided selective modality-interest alignment framework for multimodal recommendation. Inspired by an information-theoretic view, AMUR aims to enhance modality information that is more related to user interests while reducing the influence of less aligned signals. Specifically, AMUR first refines modality graph structures towards user behavior, and then selectively aligns shared interest-related semantics across modalities. This enables AMUR to improve modality-interest alignment while preserving useful modality-specific complementary information. Extensive experiments on three real-world datasets demonstrate the effectiveness of AMUR over competitive baselines. The code is available at https://github.com/Wenze1/AMUR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。