动态融合图文信息,用轻量图模型提升推荐精准度。
Gated Multimodal Graph Learning for Personalized Recommendation
- 用门控机制自适应融合视觉与文本模态
- 在亚马逊数据集上显著优于基线方法
- 结构轻量可解释,适合实际系统部署
多模态推荐通过引入产品图像和文本描述等丰富内容信息,缓解协同过滤中的冷启动与稀疏性问题。然而,如何有效整合异构模态仍具挑战。现有方法常依赖固定融合策略或复杂架构,难以适应模态质量差异且计算开销大。本文提出 RLMultimodalRec,一种轻量级模块化推荐框架,结合基于图的用户建模与自适应多模态物品编码。模型采用门控融合模块动态平衡视觉与文本模态贡献,实现细粒度、内容感知的物品表征;同时使用两层 LightGCN 编码器,在不依赖非线性变换的情况下,通过用户-物品交互图传播嵌入以捕捉高阶协同信号。我们在 Amazon 产品领域的真实数据集上评估该模型,实验结果表明,其在 Top-K 推荐指标上持续超越多种先进基线方法,包括协同过滤、视觉感知及多模态 GNN 方法,同时保持良好可扩展性与可解释性,适用于实际部署。
原文摘要 · Abstract (English)
Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However, effectively integrating heterogeneous modalities into a unified recommendation framework remains a challenge. Existing approaches often rely on fixed fusion strategies or complex architectures , which may fail to adapt to modality quality variance or introduce unnecessary computational overhead. In this work, we propose RLMultimodalRec, a lightweight and modular recommendation framework that combines graph-based user modeling with adaptive multimodal item encoding. The model employs a gated fusion module to dynamically balance the contribution of visual and textual modalities, enabling fine-grained and content-aware item representations. Meanwhile, a two-layer LightGCN encoder captures high-order collaborative signals by propagating embeddings over the user-item interaction graph without relying on nonlinear transformations. We evaluate our model on a real-world dataset from the Amazon product domain. Experimental results demonstrate that RLMultimodalRec consistently outperforms several competitive baselines, including collaborative filtering, visual-aware, and multimodal GNN-based methods. The proposed approach achieves significant improvements in top-K recommendation metrics while maintaining scalability and interpretability, making it suitable for practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。