arXiv:2507.09998cs.IR2025-07

通过迭代反馈优化异构图结构,提升多模态推荐精度。

SLIF-MR: Self-loop Iterative Fusion of Heterogeneous Auxiliary Information for Multimodal Recommendation

  • 用前一周期的物品表示作为反馈,动态更新知识图与交互图结构。
  • 在多个数据集上显著优于现有方法,尤其提升准确率与鲁棒性。
  • 适合做多模态推荐系统、融合异构信息的研究者参考。

知识图谱(KG)和多模态物品信息分别捕捉关系特征与属性特征,在提升推荐系统精度中起关键作用。近期研究通过多模态知识图谱(MKG)整合两者以进一步增强推荐性能。然而,现有方法通常在训练中冻结MKG结构,限制了异构图(如KG与用户-物品交互图)结构信息的充分融合,导致性能不佳。为此,本文提出新框架SLIF-MR:利用前一训练周期的物品表示作为反馈信号,动态优化由KG、多模态物品特征图及用户-物品交互图组成的异构图结构。通过这种自循环迭代融合机制,用户与物品表示得以持续精炼,从而提升最终推荐效果。具体而言,基于反馈的物品表示构建物品-物品关联图,并以自循环方式作为新增结构信息融入异构图构建过程,使异构图内部结构随训练迭代更新。此外,提出语义一致性学习策略,对齐跨模态的物品表示。实验表明,SLIF-MR显著优于现有方法,尤其在准确率与鲁棒性方面表现突出。

原文摘要 · Abstract (English)

Knowledge graphs (KGs) and multimodal item information, which respectively capture relational and attribute features, play a crucial role in improving recommender system accuracy. Recent studies have attempted to integrate them via multimodal knowledge graphs (MKGs) to further enhance recommendation performance. However, existing methods typically freeze the MKG structure during training, which limits the full integration of structural information from heterogeneous graphs (e.g., KG and user-item interaction graph), and results in sub-optimal performance. To address this challenge, we propose a novel framework, termed Self-loop Iterative Fusion of Heterogeneous Auxiliary Information for Multimodal Recommendation (SLIF-MR), which leverages item representations from previous training epoch as feedback signals to dynamically optimize the heterogeneous graph structures composed of KG, multimodal item feature graph, and user-item interaction graph. Through this iterative fusion mechanism, both user and item representations are refined, thus improving the final recommendation performance. Specifically, based on the feedback item representations, SLIF-MR constructs an item-item correlation graph, then integrated into the establishment process of heterogeneous graphs as additional new structural information in a self-loop manner. Consequently, the internal structures of heterogeneous graphs are updated with the feedback item representations during training. Moreover, a semantic consistency learning strategy is proposed to align heterogeneous item representations across modalities. The experimental results show that SLIF-MR significantly outperforms existing methods, particularly in terms of accuracy and robustness.

多模态推荐知识图谱自循环融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。