arXiv:2609.04442cs.CLcs.AI2026-09

用图结构追踪知识关系,让大模型自检并筛选需专家验证的结论。

GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion

论文配图:GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion
图 1 · 摘自论文原文
  • 将大模型输出拆解为原子命题,用加权图比对可信知识源
  • 可识别幻觉、新发现或有争议的命题,准确率提升23%以上
  • 适合高风险场景如医疗、金融中的模型可信度增强

在高风险场景中,大型语言模型常生成看似合理却无依据的陈述。标准检索增强生成(RAG)方法仅检索孤立段落,无法追踪跨文档证据关系或量化不确定性。我们提出GRACE(图结构反思代理协作者引擎),将大模型输出分解为原子命题,并在加权二分图中与可信知识先验进行比对。边权重表示命题与先验的接近程度,通过加权中心性分析可将命题分类为:有据、被驳回或边界类。该分类不仅能识别幻觉,还能发现模型知识前沿的新颖或争议性命题。为高效分配专家资源,我们提出注意力回报(RoA)目标函数,仅当命题优先级加权不确定性超过验证成本时才提交专家审核。经专家验证的命题被纳入新证据锚点,形成验证者-大模型演进闭环,实现知识库持续扩展。我们在多个语言模型及涵盖通用与领域知识的数据集上评估了GRACE,结果表明其知识库作为检索基础优于基线RAG,且RoA框架能有效筛选出有价值的边界知识用于专家验证。这些发现表明,结合图结构表示与人机协同验证,可在系统层面缓解幻觉问题,而非仅在生成阶段。代码见https://github.com/johnsk95/grace_code

原文摘要 · Abstract (English)

Large language models deployed in high-stakes settings frequently generate plausible but ungrounded claims. Standard retrieval-augmented generation (RAG) pipelines offer limited remedy, since they retrieve isolated passages without tracking cross-document evidence relationships or quantifying uncertainty. We introduce GRACE (Graph-grounded Reflective Agent Copilot Engine), a framework that deconstructs LLM responses into atomic claims and grounds them against trusted knowledge priors within a weighted bipartite graph. Edge weights encode the closeness of each claim to the priors, enabling weighted centrality analysis that classifies claims as Grounded, Refuted, or Boundary. Such classification identifies not just hallucinations but also novel or contested claims at the frontier of the model's knowledge. To efficiently allocate human or agent resources, we formulate a Return on Attention (RoA) objective that defers a claim to expert review only when its priority-weighted uncertainty exceeds the cost of verification. Claims verified by experts are promoted to new evidence anchors, closing a validator-LLM evolutionary loop that expands the knowledge base across iterations. We evaluate GRACE across multiple language models and on datasets spanning both general and domain-specific knowledge. Our results show that our knowledge base serves as a reliable foundation for retrieval that outperforms RAG baselines, and that the RoA framework efficiently selects valuable boundary knowledge for expert verification. These findings demonstrate that graph-structured representations combined with expert-in-the-loop verification can mitigate hallucination at the system level rather than at the generation level. Code available at https://github.com/johnsk95/grace_code

大模型可信度知识图谱人机协同幻觉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。