arXiv:2511.00584cs.IRcs.CL2025-11中稿 · IEEE Transactions …被引 5

提出SRGFormer模型,通过超图结构提升多模态推荐的用户行为建模能力。

Structurally Refined Graph Transformer for Multimodal Recommendation

  • 用超图融合多模态信息,增强用户-物品局部结构建模
  • 在Sports数据集上平均性能提升4.47%,优于现有基准
  • 适合需要精细捕捉用户偏好与多模态交互的研究者

多模态推荐系统利用图像、文本等多源信息提升推荐效果,核心挑战在于从数据中预测用户购买行为。现有模型过度关注多模态特征提取,忽视冗余与有效信息的区分,且依赖单一语义框架(如局部或全局语义),导致用户偏好表征不完整或存在偏差,尤其对历史交互较少的用户表现不佳。同时,难以捕捉用户与物品间的复杂交互,限制了对多样化需求的满足。为此,本文提出结构优化的多模态推荐模型SRGFormer:通过改进Transformer以更好融入模型,捕获用户整体行为模式;将多模态信息嵌入超图结构,辅助学习用户-物品间的局部结构;结合自监督任务强化用户-物品协同信号,促进多模态信息融合,揭示数据内在模态特征。在三个公开数据集上的实验表明,SRGFormer显著优于基线模型,在Sports数据集上平均性能提升4.47%。代码已公开。

原文摘要 · Abstract (English)

Multimodal recommendation systems utilize various types of information, including images and text, to enhance the effectiveness of recommendations. The key challenge is predicting user purchasing behavior from the available data. Current recommendation models prioritize extracting multimodal information while neglecting the distinction between redundant and valuable data. They also rely heavily on a single semantic framework (e.g., local or global semantics), resulting in an incomplete or biased representation of user preferences, particularly those less expressed in prior interactions. Furthermore, these approaches fail to capture the complex interactions between users and items, limiting the model's ability to meet diverse users. To address these challenges, we present SRGFormer, a structurally optimized multimodal recommendation model. By modifying the transformer for better integration into our model, we capture the overall behavior patterns of users. Then, we enhance structural information by embedding multimodal information into a hypergraph structure to aid in learning the local structures between users and items. Meanwhile, applying self-supervised tasks to user-item collaborative signals enhances the integration of multimodal information, thereby revealing the representational features inherent to the data's modality. Extensive experiments on three public datasets reveal that SRGFormer surpasses previous benchmark models, achieving an average performance improvement of 4.47 percent on the Sports dataset. The code is publicly available online.

多模态推荐超图建模自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。