用多专家协作让推荐系统精准匹配用户查询的复杂度。
Mixture-of-Experts Knowledge Graph Retrieval-Augmented Generation for Multi-Agent LLM-based Recommendation

- 按查询复杂度自动分配不同粒度的知识图谱检索专家
- 通过对比学习强化推荐反馈,提升知识对齐精度
- 适合需要动态知识更新的智能推荐场景
大语言模型(LLM)因能理解用户意图和物品语义而被用于推荐系统。然而,现有基于LLM的推荐系统依赖静态参数化知识,存在知识过时问题,促使知识图谱检索增强生成(KG-RAG)方法兴起,以利用结构化、实时的KG数据。但该方法在推荐中面临三大挑战:一是用户查询复杂度各异,现有方法采用统一检索策略,导致简单查询过度检索、复杂查询检索不足;二是将图结构数据转为线性文本会引入噪声并丢失结构信息;三是检索粒度选择缺乏直接监督,需在最终推荐后反推,难以端到端学习。为此,我们提出MixRAGRec,一种协同多智能体框架,包含:混合专家检索代理(按粒度路由查询)、知识偏好对齐代理(将结构化知识转为自然语言)、以及基于对比学习强化的推荐代理。特别地,我们引入多智能体策略优化(MMAPO)统一训练三者。在真实数据集上的实验验证了该框架的有效性。
原文摘要 · Abstract (English)
Large language models (LLMs) have recently been adopted for recommendations due to their ability to understand user intent and item semantics. However, LLM-based recommender systems often rely on parametric knowledge and suffer from outdated knowledge, motivating knowledge graph retrieval-augmented generation (KG-RAG) to ground recommendations on structured, up-to-date KGs. Despite this promise, effective KG-RAG in recommendations faces great challenges. First, users' queries vary in complexity and require KG knowledge at different granularities, whereas existing methods adopt a one-size-fits-all retrieval strategy, leading to over-retrieval for simple queries and under-retrieval for complex ones. In addition, augmenting LLMs with KG knowledge requires translating graph-structured data into linear text, which may introduce noise and cause structural information loss. Moreover, the selection of retrieval granularity lacks direct supervision and must be inferred from the final recommendation after alignment and downstream utilization, making query-aware retrieval hard to learn end-to-end. To address these issues, we propose MixRAGRec, a cooperative multi-agent framework for KG-RAG recommendations. MixRAGRec integrates a Mixture-of-Experts Retrieval Agent that routes each query to a KG retrieval expert with different granularities, a Knowledge Preference Alignment Agent that converts structured knowledge into LLM-friendly natural language, and a Contrastive Learning-reinforced Recommendation Agent trained with contrastive preference feedback. Notably, we introduce Mixture-of-Experts Multi-Agent Policy Optimization (MMAPO) to train three agents under a unified objective. Extensive experiments on real-world datasets demonstrate the effectiveness of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。