arXiv:2605.05103cs.CLcs.AI2026-05

用语料库构建概念场,检测文本生成中的幻觉与新颖性。

Text Corpora as Concept Fields: Black-Box Hallucination and Novelty Measurement

论文配图:Text Corpora as Concept Fields: Black-Box Hallucination and Novelty Measurement
图 1 · 摘自论文原文
  • 基于句子嵌入的局部漂移场,通过z距离衡量句子过渡合理性。
  • 在联邦法规和古腾堡项目中实现高精度幻觉与新颖性分类。
  • 无需模型内部信息,可解释性强,适合跨领域应用。

我们提出文本语料库的「概念场」:在句子嵌入空间中,通过连续句间差异估计的局部漂移场,带有点级不确定性。给定候选句过渡,通过ζ(观测差值与场局部高斯估计的平均绝对z距离)评分,该评分具有黑箱性、语料归属性,并在局部高斯近似下具概率解释。为此引入向量序列数据库(VSDB),存储嵌入及序列位置、下一差值元数据。在两个大规模场景评估:美国联邦法规上的幻觉式置信度检测,以及古腾堡项目上的新颖性检测。结果表明,概念场在置信度/非置信度/不确定三分类策略下表现优异。相比检索基准,两种域的覆盖率-风险行为相似,支持标准化偏差得分的跨域稳定性。我们还探索了密集聚类上概念场的散度与旋度,揭示逻辑源、汇与隐含主题等语义模式,作为假设生成而非定量结果。概念场为置信度与新颖性提供快速、轻量、可解释的信号,补充大模型评判与白盒检测。

原文摘要 · Abstract (English)

We introduce the \textbf{Concept Field} of a text corpus: a local drift field with pointwise uncertainty, estimated in sentence-embedding space from the deltas between consecutive sentences. Given a candidate sentence transition, we score its agreement with the field by $ζ$, the mean absolute z-distance between the observed delta and the field's local Gaussian estimate. The score is black-box (no model internals), corpus-attributable (every score traces to nearby corpus sentences), and admits a probabilistically motivated interpretation under a local Gaussian approximation. We support the computation with the introduction of a \textbf{Vector Sequence Database (VSDB)} that stores embeddings together with sequence-position and next-delta metadata. We evaluate this approach on two large-scale settings: hallucination-style groundedness detection over the U.S. Code of Federal Regulations, and novelty detection over Project Gutenberg, where we show Concept Fields achieve strong selective classification performance under a grounded / ungrounded / unsure triage policy. Unlike retrieval-centric baselines, the resulting coverage-risk behavior is similar across both domains, supporting a degree of cross-domain stability for the standardized deviation score. We also sketch how divergence and curl of the Concept Field, computed on dense clusters, surface qualitatively meaningful semantic patterns (logic sources, sinks, and implicit topics), which we offer as hypothesis-generating rather than as a quantitative result. Concept Fields provide a fast, lightweight, and interpretable signal for groundedness and novelty, complementary to LLM-as-judge and white-box detectors.

幻觉检测语义场可解释性文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。