用多智能体协作让大模型在知识图谱上更准更可解释地推理
RACER: Reinforced Agent Collaboration for Explainable Reasoning on Knowledge Graphs

- 设计多智能体系统动态规划推理路径,结合语义剪枝与强化学习
- 在CommonsenseQA和OpenBookQA上平均提升5%,显著优于现有方法
- 适合需要高可解释性推理的AI应用,如医疗、金融决策支持
大型语言模型(LLMs)常出现幻觉,难以处理需多跳领域知识的复杂推理任务。尽管知识图谱(KG)提供结构化且可验证的信息源,现有增强型模型通常依赖单智能体路径提取与固定提示,适应性差且搜索空间过大。为此,我们提出RACER:一种用于知识图谱可解释推理的强化智能体协作框架。RACER采用语义感知动作剪枝与教师引导的强化学习机制,高效从大规模知识图谱中提取高质量推理路径。为缓解单一路径生成缺陷,引入跨任务累积共享记忆图,并搭配注意力驱动的多路径知识精炼模块。最终,RACER通过四角色多智能体协作系统(GraphAgent、TemplateAgent、AnswerAgent、CriticAgent)动态优化提示并评估答案。在CommonsenseQA和OpenBookQA数据集上的大量实验表明,RACER显著优于当前最优的KG增强型LLM基线,平均性能提升5%,具备鲁棒且高度可解释的推理能力。
原文摘要 · Abstract (English)
Large Language Models (LLMs) often suffer from hallucination and struggle with complex reasoning tasks requiring multi-hop domain knowledge. While integrating Knowledge Graphs (KGs) provides a structured and verifiable information source, current KG-enhanced LLM paradigms usually rely on single-agent path extraction and fixed prompting, lacking adaptability and facing huge search spaces. To address these challenges, we propose RACER, a Reinforced Agent Collaboration framework for Explainable Reasoning on knowledge graphs. RACER employs a semantic-aware action pruning and teacher-guided reinforcement learning mechanism to efficiently extract high-quality reasoning pathways from large-scale KGs. Furthermore, to mitigate single-path generation pitfalls, we introduce a cross-task accumulated shared memory graph paired with an attention-driven multi-path knowledge refinement module. Finally, RACER orchestrates these components through a four-role multi-agent collaboration system (GraphAgent, TemplateAgent, AnswerAgent, and CriticAgent) to dynamically refine prompts and evaluate answers. Extensive experiments on CommonsenseQA and OpenBookQA datasets demonstrate that RACER significantly outperforms state-of-the-art KG-enhanced LLM baselines with an average improvement of 5\%, offering robust and highly interpretable reasoning capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。