用物品共购图无训练补全缺失多模态数据,提升推荐系统性能。
Training-free Graph-based Imputation of Missing Modalities in Multimodal Recommendation
- 基于物品共购图结构,通过图特征插值补全缺失模态信息。
- 在多个数据集上优于传统填充方法,且不需重新训练模型。
- 首次分析物品特征同质性对补全效果的影响,适合推荐系统研究者。
多模态推荐系统常因商品图像、描述等模态数据缺失或噪声而受限。现有方法通常直接丢弃缺失模态的物品,仅在子集上训练模型。本文首次形式化了多模态推荐中的缺失模态问题。利用用户-物品图结构,将缺失模态补全重构为物品-物品共购图上的特征插值问题,提出四种无需训练的补全方法,通过图传播恢复缺失模态特征。在多个主流多模态推荐数据集上的实验表明,该方法可无缝集成至任意现有模型与评估框架,保持甚至扩大多模态与传统推荐系统的性能差距。同时,其在不同缺失场景下表现优于传统机器学习填充方法。最后,首次分析了物品图上特征同质性对补全效果的影响。
原文摘要 · Abstract (English)
Multimodal recommender systems (RSs) represent items in the catalog through multimodal data (e.g., product images and descriptions) that, in some cases, might be noisy or (even worse) missing. In those scenarios, the common practice is to drop items with missing modalities and train the multimodal RSs on a subsample of the original dataset. To date, the problem of missing modalities in multimodal recommendation has still received limited attention in the literature, lacking a precise formalisation as done with missing information in traditional machine learning. In this work, we first provide a problem formalisation for missing modalities in multimodal recommendation. Second, by leveraging the user-item graph structure, we re-cast the problem of missing multimodal information as a problem of graph features interpolation on the item-item co-purchase graph. On this basis, we propose four training-free approaches that propagate the available multimodal features throughout the item-item graph to impute the missing features. Extensive experiments on popular multimodal recommendation datasets demonstrate that our solutions can be seamlessly plugged into any existing multimodal RS and benchmarking framework while still preserving (or even widen) the performance gap between multimodal and traditional RSs. Moreover, we show that our graph-based techniques can perform better than traditional imputations in machine learning under different missing modalities settings. Finally, we analyse (for the first time in multimodal RSs) how feature homophily calculated on the item-item graph can influence our graph-based imputations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。