为多模态推荐设计独立接收域的图网络,提升信息融合效果
Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation
- 不同模态用独立接收域的图网络,避免信息瓶颈
- 实测某些模态最优接收域仅为1-2跳,限制全局信息捕获
- 引入全局采样变压器,有效整合跨节点全局信息
多模态推荐系统可通过用户-项目交互和项目关联的多模态数据语义来学习用户偏好。现有方法通常构建多模态用户-项目图,将多模态推荐视为图学习任务。图神经网络(GNN)在此领域表现优异,依赖其在特定感受野内(通常以跳跃数$K$表示)捕捉邻域信息的能力来丰富用户与项目语义。我们发现,不同模态的最佳感受野可能不同。本文提出具有模态独立感受野的GNN,为不同模态分别使用独立感受野的GNN以提升性能。实验表明,在特定数据集上,某些模态的最优$K$低至1或2,这可能限制了GNN捕捉全局信息的能力。为此,我们引入基于采样的全局变压器,通过均匀全局采样有效集成全局信息。全面实验验证了该方法优于现有方法。代码已公开于https://github.com/CrawlScript/MIG-GT。
原文摘要 · Abstract (English)
Multimodal recommendation systems can learn users' preferences from existing user-item interactions as well as the semantics of multimodal data associated with items. Many existing methods model this through a multimodal user-item graph, approaching multimodal recommendation as a graph learning task. Graph Neural Networks (GNNs) have shown promising performance in this domain. Prior research has capitalized on GNNs' capability to capture neighborhood information within certain receptive fields (typically denoted by the number of hops, $K$) to enrich user and item semantics. We observe that the optimal receptive fields for GNNs can vary across different modalities. In this paper, we propose GNNs with Modality-Independent Receptive Fields, which employ separate GNNs with independent receptive fields for different modalities to enhance performance. Our results indicate that the optimal $K$ for certain modalities on specific datasets can be as low as 1 or 2, which may restrict the GNNs' capacity to capture global information. To address this, we introduce a Sampling-based Global Transformer, which utilizes uniform global sampling to effectively integrate global information for GNNs. We conduct comprehensive experiments that demonstrate the superiority of our approach over existing methods. Our code is publicly available at https://github.com/CrawlScript/MIG-GT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。