arXiv:2512.00663cs.CLcs.AI2025-12

用可视化图谱追踪大模型幻觉,让错误来源一目了然。

Graphing the Truth: Structured Visualizations for Automated Hallucination Detection in LLMs

  • 将知识与模型输出构建成可交互的知识图谱
  • 通过源信息关联和置信度标记识别幻觉区域
  • 适合需要高可信响应的企业用户和审核人员

大语言模型在企业场景中常结合专有领域知识以提供更精准回答,但受限于上下文长度和训练数据与新增知识的不一致,常产生看似合理却虚假的幻觉内容,难以通过人工审查发现。现有方法依赖昂贵的高质量问答标注或二次模型验证,无法保证确定性。本文提出一种框架,将私有知识与模型生成内容组织成可交互的可视化知识图谱,通过链接模型断言与原始知识源并标注置信度,使用户能直观识别潜在幻觉区域,诊断推理缺陷,并反馈修正。该人机协同流程构建结构化反馈回路,持续提升模型可靠性与回答质量。

原文摘要 · Abstract (English)

Large Language Models have rapidly advanced in their ability to interpret and generate natural language. In enterprise settings, they are frequently augmented with closed-source domain knowledge to deliver more contextually informed responses. However, operational constraints such as limited context windows and inconsistencies between pre-training data and supplied knowledge often lead to hallucinations, some of which appear highly credible and escape routine human review. Current mitigation strategies either depend on costly, large-scale gold-standard Q\&A curation or rely on secondary model verification, neither of which offers deterministic assurance. This paper introduces a framework that organizes proprietary knowledge and model-generated content into interactive visual knowledge graphs. The objective is to provide end users with a clear, intuitive view of potential hallucination zones by linking model assertions to underlying sources of truth and indicating confidence levels. Through this visual interface, users can diagnose inconsistencies, identify weak reasoning chains, and supply corrective feedback. The resulting human-in-the-loop workflow creates a structured feedback loop that can enhance model reliability and continuously improve response quality.

幻觉检测知识图谱人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。