arXiv:2604.03666cs.IR2026-04

用多模态检索路径增强大模型,让推荐解释更准确可信。

MMP-Refer: Multimodal Path Retrieval-augmented LLMs For Explainable Recommendation

  • 通过多模态嵌入搜索推荐路径,提升信息丰富度。
  • 引入轻量适配器将交互图编码映射到大模型语义空间。
  • 适合需要透明解释的个性化推荐场景。

可解释推荐能提升推荐系统的透明度与可信度,在个性化推荐中至关重要。现有基于大语言模型(LLMs)的方法常引入协同信息以增强个性化与准确性,但忽略了推荐数据集中的多模态信息;且协同信号需对齐至大模型的语义空间。通过检索路径引入协同信号是有效方案,但现有路径生成多依赖可解释GNN算法,虽有效却解释性不足,不适用于推荐领域。为此,我们提出MMP-Refer框架:利用基于联合残差编码的序列推荐模型获取多模态嵌入,并设计启发式搜索算法,通过多模态嵌入生成检索路径;在生成阶段,引入可训练的轻量级协同适配器,将交互子图的图编码映射至大模型语义空间,作为软提示,增强大模型对交互信息的理解。大量实验验证了方法的有效性。代码与数据已公开于https://github.com/pxcstart/MMP-Refer。

原文摘要 · Abstract (English)

Explainable recommendations help improve the transparency and credibility of recommendation systems, and play an important role in personalized recommendation scenarios. At present, methods for explainable recommendation based on large language models(LLMs) often consider introducing collaborative information to enhance the personalization and accuracy of the model, but ignore the multimodal information in the recommendation dataset; In addition, collaborative information needs to be aligned with the semantic space of LLM. Introducing collaborative signals through retrieval paths is a good choice, but most of the existing retrieval path collection schemes use the existing Explainable GNN algorithms. Although these methods are effective, they are relatively unexplainable and not be suitable for the recommendation field. To address the above challenges, we propose MMP-Refer, a framework using \textbf{M}ulti\textbf{M}odal Retrieval \textbf{P}aths with \textbf{Re}trieval-augmented LLM \textbf{F}or \textbf{E}xplainable \textbf{R}ecommendation. We use a sequential recommendation model based on joint residual coding to obtain multimodal embeddings, and design a heuristic search algorithm to obtain retrieval paths by multimodal embeddings; In the generation phase, we integrated a trainable lightweight collaborative adapter to map the graph encoding of interaction subgraphs to the semantic space of the LLM, as soft prompts to enhance the understanding of interaction information by the LLM. Extensive experiments have demonstrated the effectiveness of our approach. Codes and data are available at https://github.com/pxcstart/MMP-Refer.

可解释推荐多模态大模型路径检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。