arXiv:2508.13745cs.IR2025-08中稿 · as a full paper at…被引 6

通过优化多模态对比学习与同构关系,提升稀疏场景下的推荐效果。

Refining Contrastive Learning and Homography Relations for Multi-Modal Recommendation

  • 引入元网络与正交约束,过滤共享特征噪声,保留独特特征信息。
  • 构建用户兴趣图与物品共现图,更全面挖掘用户-物品互动关系。
  • 在三个真实数据集上表现优于主流方法,适合多模态推荐研究者。

多模态推荐系统利用物品的图像和文本描述等丰富模态信息以提升推荐性能。现有方法虽借助图神经网络的强大结构建模能力取得显著进展,但在现实场景中仍受数据稀疏性制约。尽管对比学习和同构图(homography)被用于缓解数据稀疏问题,但现有方法仍存在两大局限:1)简单多模态特征对比难以生成有效表示,导致模态共享特征噪声大,模态独有特征信息丢失;2)未充分探索用户兴趣与物品共现之间的同构关系,导致用户-物品交互挖掘不完整。为此,本文提出新颖框架REARM,通过元网络与正交约束策略增强多模态对比学习,有效过滤共享特征噪声并保留独有特征中的推荐相关信号;同时,融合新构建的用户兴趣图与物品共现图,与已有用户共现图和物品语义图共同支持图学习。在三个真实世界数据集上的大量实验表明,REARM显著优于多种先进基线方法。可视化结果进一步显示,REARM能更好地区分模态共享与独有特征。代码已开源。

原文摘要 · Abstract (English)

Multi-modal recommender system focuses on utilizing rich modal information ( i.e., images and textual descriptions) of items to improve recommendation performance. The current methods have achieved remarkable success with the powerful structure modeling capability of graph neural networks. However, these methods are often hindered by sparse data in real-world scenarios. Although contrastive learning and homography ( i.e., homogeneous graphs) are employed to address the data sparsity challenge, existing methods still suffer two main limitations: 1) Simple multi-modal feature contrasts fail to produce effective representations, causing noisy modal-shared features and loss of valuable information in modal-unique features; 2) The lack of exploration of the homograph relations between user interests and item co-occurrence results in incomplete mining of user-item interplay. To address the above limitations, we propose a novel framework for \textbf{R}\textbf{E}fining multi-mod\textbf{A}l cont\textbf{R}astive learning and ho\textbf{M}ography relations (\textbf{REARM}). Specifically, we complement multi-modal contrastive learning by employing meta-network and orthogonal constraint strategies, which filter out noise in modal-shared features and retain recommendation-relevant information in modal-unique features. To mine homogeneous relationships effectively, we integrate a newly constructed user interest graph and an item co-occurrence graph with the existing user co-occurrence and item semantic graphs for graph learning. The extensive experiments on three real-world datasets demonstrate the superiority of REARM to various state-of-the-art baselines. Our visualization further shows an improvement made by REARM in distinguishing between modal-shared and modal-unique features. Code is available \href{https://github.com/MrShouxingMa/REARM}{here}.

多模态推荐对比学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。