用大模型优化用户偏好与物品图谱,提升多模态推荐效果
MLLMRec: A Preference Reasoning Paradigm with Graph Refinement for Multimodal Recommendation
- 用多模态大模型生成物品语义描述,精准提炼用户行为意图
- 通过去噪和拓扑增强重构物品关系图,提升表示学习质量
- 在三个数据集上性能超越基线21.48%,适合推荐系统研究者
多模态推荐通过融合用户历史行为与物品的多模态特征,捕捉真实用户偏好,表现优于传统基于ID的推荐系统。然而现有方法在用户与物品表示学习中仍存在两大问题:(1) 用户初始表示或忽略历史行为,或受无关模态噪声污染;(2) 广泛使用的KNN构建的物品-物品图包含低相似度噪声边,且缺乏共现关系。为此,我们提出MLLMRec,一种基于图精化的多模态推荐偏好推理范式。一方面,利用多模态大语言模型(MLLM)将物品图像转化为高质量语义描述,弥合视觉与文本模态间的语义鸿沟;随后为每位用户构建行为描述列表,输入MLLM以推断出蕴含潜在交互意图的纯净用户偏好。另一方面,设计阈值控制去噪与拓扑感知增强策略,对次优物品图进行精炼,提升物品表示学习精度。在三个公开数据集上的大量实验表明,MLLMRec相比最优基线平均提升21.48%。源代码已开源。
原文摘要 · Abstract (English)
Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However, existing methods still encounter two key problems in the representation learning of users and items, respectively: (1) the initialization of multimodal user representations is either agnostic to historical behaviors or contaminated by irrelevant modal noise, and (2) the widely used KNN-based item-item graph contains noisy edges with low similarities and lacks audience co-occurrence relationships. To address such issues, we propose MLLMRec, a novel preference reasoning paradigm with graph refinement for multimodal recommendation. Specifically, on the one hand, the item images are first converted into high-quality semantic descriptions using a multimodal large language model (MLLM), thereby bridging the semantic gap between visual and textual modalities. Then, we construct a behavioral description list for each user and feed it into the MLLM to reason about the purified user preference profiles that contain the latent interaction intents. On the other hand, we develop the threshold-controlled denoising and topology-aware enhancement strategies to refine the suboptimal item-item graph, thereby improving the accuracy of item representation learning. Extensive experiments on three publicly available datasets demonstrate that MLLMRec achieves the state-of-the-art performance with an average improvement of 21.48% over the optimal baselines. The source code is provided at https://github.com/Yuzhuo-Dang/MLLMRec.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。