arXiv:2608.23370cs.AIcs.LO2026-08

让大模型学会识别并追踪错误信息,防止胡说八道被当作事实。

Walking on the DARKSIDE

  • 在POLANYI++基础上增加排除路径追踪和证据等级分类机制
  • 在BSBench测试中使错误生成率下降67%,假信息识别准确率达92%
  • 适合需要高可信推理的领域如医疗、金融、法律的模型审计

大型语言模型虽能识别模式,但无法追踪论述中被排除的信息路径。当输入基于虚构权威、误用机制或隐秘类比时,未受引导的模型会将其视为真实,并将错误固化为结构化输出。现有逻辑增强生成方法POLANYI++虽能构建扩展知识图谱(XKG),但同样易将复杂伪命题纳入其中,且难以被自动推理器发现。本文提出DARKSIDE,一种在POLANYI++之上的连贯性审计方法,通过显式数据结构记录话语时间轴上的累积排除路径,并引入证言轴对每个命名实体分类为:有据可查、无据可依、误归因或虚构,设定阈值触发风险升级至不安全。在包含100项对抗性伪命题的BSBench数据集上,以Gemini 3为生成模型,Claude Sonnet 4.6为独立裁判,实验证明:当模型前向传播嵌入基于本体的负向路径机制时,模式与路径之间的鸿沟可部分弥合。XKG充当缺失的记忆,证言轴则构成认知防火墙。

原文摘要 · Abstract (English)

Large Language Models (LLMs) recognise patterns but do not natively track the path of exclusions that a coherent discourse demands. When an input rests on a fabricated authority, a misapplied mechanism, or a surreptitious analogy, an unsteered LLM tends to engage with it as if it were grounded, and to reify the misstep into any structured output it generates. Logic-Augmented Generation (LAG) with POLANYI++, an LLM-steering method that uses heuristics, ontologies and problem solving methods for tacit knowledge extraction, produces an Extended Knowledge Graph (XKG) in OWL2, but inherits the same vulnerability: a sophisticated nonsensical input is reified into the graph alongside the legitimate triples, and is hardly detectable by automated reasoners since the XKG is generated jointly with the wrong assumptions. We introduce DARKSIDE, a coherence auditing method on top of POLANYI++. It formalises the trail as an explicit data structure of accumulated exclusions over discourse time, complemented by a warrant axis that classifies each named referent as Warranted, Unattested, Misattributed or Fabricated, with an escalation rule that pushes the DelegationRiskAssessment to UNSAFE when the fabricated rate is positive or the unsupported rate exceeds a threshold. We evaluate DARKSIDE as a steering layer over a Gemini 3 on BSBench, a 100-item adversarial corpus of sophisticated-sounding nonsense across software engineering, finance, healthcare, physics and law, with Claude Sonnet 4.6 as an independent judge. The empirical evidence supports an architectural claim: when an LLM forward pass is wrapped in an ontology-mediated negative-trail apparatus, the structural pattern-vs-path gap can be partially scaffolded. The XKG functions as the missing memory, and the warrant axis as an epistemic firewall.

大模型审计知识图谱逻辑推理可信生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。