用图模型+强化学习+LLM重排,提升推荐系统精准度与个性化。
GraphRAG-IRL: Personalized Recommendation with Graph-Grounded Inverse Reinforcement Learning and LLM Re-ranking

- 构建异构知识图谱,结合个体与社区偏好做预排序。
- 在MovieLens上提升15.7%的NDCG@10,KuaiRand上提升16.6%。
- 适合追求高精度推荐与个性化建模的研究者和工程师。
个性化推荐需要能捕捉用户序列偏好且对稀疏反馈和语义模糊鲁棒的模型。现有工作尝试将大语言模型(LLMs)作为推荐器或重排器,但纯提示驱动的排序常存在校准差、候选顺序敏感及流行度偏差问题,导致其作为独立排序引擎不可靠。我们提出GraphRAG-IRL,一种融合图结构特征构建、逆强化学习(IRL)与角色引导式LLM重排的混合推荐框架。该方法在物品、类别与概念上构建异构知识图谱,检索个体与社区偏好上下文,利用这些信号训练最大熵逆强化学习模型进行校准预排序。随后仅对短候选列表应用LLM,通过角色引导提示提供互补语义判断,并与IRL得分融合。实验表明,GraphRAG-IRL是强效独立推荐器:IRL-MLP搭配GraphRAG在MovieLens上比监督基线提升15.7% NDCG@10,KuaiRand上提升16.6%。结果还显示IRL与GraphRAG具有超加性,联合增益超过各自提升之和。角色引导式LLM融合进一步优化排序质量,在MovieLens ml-1m上相较IRL仅基线最高提升16.8% NDCG@10;KuaiRand上不同LLM提供商均实现4–6%的稳定提升。
原文摘要 · Abstract (English)
Personalized recommendation requires models that capture sequential user preferences while remaining robust to sparse feedback and semantic ambiguity. Recent work has explored large language models (LLMs) as recommenders and re-rankers, but pure prompt-based ranking often suffers from poor calibration, sensitivity to candidate ordering, and popularity bias. These limitations make LLMs useful semantic reasoners, but unreliable as standalone ranking engines. We present \textbf{GraphRAG-IRL}, a hybrid recommendation framework that combines graph-grounded feature construction, inverse reinforcement learning (IRL), and persona-guided LLM re-ranking. Our method constructs a heterogeneous knowledge graph over items, categories, and concepts, retrieves both individual and community preference context, and uses these signals to train a Maximum Entropy IRL model for calibrated pre-ranking. An LLM is then applied only to a short candidate list, where persona-guided prompts provide complementary semantic judgments that are fused with IRL rankings. Experiments show that GraphRAG-IRL is a strong standalone recommender: IRL-MLP with GraphRAG improves NDCG@10 by 15.7\% on MovieLens and 16.6\% on KuaiRand over supervised baselines. The results also show that IRL and GraphRAG are superadditive, with the combined gain exceeding the sum of their individual improvements. Persona-guided LLM fusion further improves ranking quality, yielding up to 16.8\% NDCG@10 improvement over the IRL-only baseline on MovieLens ml-1m, while score fusion on KuaiRand provides consistent gains of 4--6\% across LLM providers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。