用两个智能体分工协作,让知识图谱推理更可靠且省钱。
R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs
- 一个低配模型搜证据,一个高配模型做判断,分工降低开销。
- 在5个数据集上表现优于基线,无论低配模型能力如何都稳定可靠。
- 引入拒答机制,证据不足时不输出,适合对可靠性要求高的场景。
近期研究将大语言模型(LLMs)与知识图谱(KGs)结合以提升推理能力,在无需额外训练的情况下提高推理准确率并缓解幻觉问题。然而现有框架存在两大实际缺陷:一旦知识图谱或推理任务改变就必须重新调参,且依赖单一高性能大模型进行可靠推理。为此,我们提出R2-KG,一种即插即用的双智能体框架,将推理分为两个角色:操作者(低容量LLM)负责收集证据,监督者(高容量LLM)作出最终判断。该设计在保持强推理准确率的同时显著降低大模型推理成本。此外,R2-KG采用拒答机制,仅当从知识图谱中收集到足够证据时才生成答案,极大提升了可靠性。在五个不同基准上的实验表明,R2-KG在准确率和可靠性方面均持续优于基线,且不依赖操作者模型的能力。进一步实验显示,单智能体版本结合严格自洽策略,虽增加拒答率但在复杂知识图谱中显著提升可靠性并降低推理成本。结果表明,R2-KG是一种灵活、低成本的基于知识图谱的推理解决方案,减少了对高容量模型的依赖,同时确保可信推断。代码已公开于https://github.com/ekrxjwh2009/R2-KG/。
原文摘要 · Abstract (English)
Recent studies have combined Large Language Models (LLMs) with Knowledge Graphs (KGs) to enhance reasoning, improving inference accuracy without additional training while mitigating hallucination. However, existing frameworks still suffer two practical drawbacks: they must be re-tuned whenever the KG or reasoning task changes, and they depend on a single, high-capacity LLM for reliable (i.e., trustworthy) reasoning. To address this, we introduce R2-KG, a plug-and-play, dual-agent framework that separates reasoning into two roles: an Operator (a low-capacity LLM) that gathers evidence and a Supervisor (a high-capacity LLM) that makes final judgments. This design is cost-efficient for LLM inference while still maintaining strong reasoning accuracy. Additionally, R2-KG employs an Abstention mechanism, generating answers only when sufficient evidence is collected from KG, which significantly enhances reliability. Experiments across five diverse benchmarks show that R2-KG consistently outperforms baselines in both accuracy and reliability, regardless of the inherent capability of LLMs used as the Operator. Further experiments reveal that the single-agent version of R2-KG, equipped with a strict self-consistency strategy, achieves significantly higher-than-baseline reliability with reduced inference cost but increased abstention rate in complex KGs. Our findings establish R2-KG as a flexible and cost-effective solution for KG-based reasoning, reducing reliance on high-capacity LLMs while ensuring trustworthy inference. The code is available at https://github.com/ekrxjwh2009/R2-KG/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。