arXiv:2509.03857cs.AI2025-09AAAI被引 3

用知识图谱对比检测大模型幻觉,实时发现语义错误。

Continuous Monitoring of Large-Scale Generative AI via Deterministic Knowledge Graph Structures

  • 构建规则生成的确定性知识图谱与实时生成的LLM图谱进行对比。
  • 通过ICR、IPR等指标量化差异,异常值超过历史阈值即报警。
  • 适合关注模型可靠性、需持续监控的AI系统开发者。

生成式AI模型虽在多领域革新应用,但存在幻觉、语义漂移和固有偏见等可靠性问题,且常作为黑箱运行,难以透明评估。现有方法多依赖主观人工判断,难以扩展。本文提出一种基于确定性知识图谱(KG)与大语言模型(LLM)动态生成图谱的连续监控方法。构建两类并行图谱:(i) 基于显式规则、预定义本体、领域词典和结构化实体-关系提取规则的确定性图谱;(ii) 从实时新闻流中动态生成的LLM图谱。利用实时数据确保真实性,避免训练重复偏差与反馈记忆绕过基准。采用实例化类比率(ICR)、实例化属性比率(IPR)和类实例化(CI)等成熟图谱度量,持续计算两类图谱间的结构偏差与语义差异。基于历史度量分布建立动态异常阈值,主动识别显著偏差,及时预警语义异常或幻觉。该结构化、度量驱动的对比框架实现了可靠、可扩展的生成式AI评估。

原文摘要 · Abstract (English)

Generative AI (GEN AI) models have revolutionized diverse application domains but present substantial challenges due to reliability concerns, including hallucinations, semantic drift, and inherent biases. These models typically operate as black-boxes, complicating transparent and objective evaluation. Current evaluation methods primarily depend on subjective human assessment, limiting scalability, transparency, and effectiveness. This research proposes a systematic methodology using deterministic and Large Language Model (LLM)-generated Knowledge Graphs (KGs) to continuously monitor and evaluate GEN AI reliability. We construct two parallel KGs: (i) a deterministic KG built using explicit rule-based methods, predefined ontologies, domain-specific dictionaries, and structured entity-relation extraction rules, and (ii) an LLM-generated KG dynamically derived from real-time textual data streams such as live news articles. Utilizing real-time news streams ensures authenticity, mitigates biases from repetitive training, and prevents adaptive LLMs from bypassing predefined benchmarks through feedback memorization. To quantify structural deviations and semantic discrepancies, we employ several established KG metrics, including Instantiated Class Ratio (ICR), Instantiated Property Ratio (IPR), and Class Instantiation (CI). An automated real-time monitoring framework continuously computes deviations between deterministic and LLM-generated KGs. By establishing dynamic anomaly thresholds based on historical structural metric distributions, our method proactively identifies and flags significant deviations, thus promptly detecting semantic anomalies or hallucinations. This structured, metric-driven comparison between deterministic and dynamically generated KGs delivers a robust and scalable evaluation framework.

生成式AI知识图谱幻觉检测持续监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。