arXiv:2510.21891cs.CLcs.AI2025-10被引 2

用语义均匀性检测长文本生成中的虚假信息,无需标注数据。

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

  • 通过嵌入向量在单位球面的分布均匀性评估生成文本可信度。
  • 嵌入分散度越高,事实一致性越差,能有效预测非真实性。
  • 无需训练或调参,适用于各类模型,适合实际部署场景。

为在高风险应用中部署大语言模型(LLMs),需可靠且低成本的方法评估其对开放式提示生成的长文本响应的可信度。现有方法多依赖逐条事实核查,计算成本高且在长文本中表现脆弱。本文提出语义均匀性——即归一化文本嵌入在单位球面上的均匀程度——用于评估响应可信度。通过生成多个长文本响应并计算其嵌入向量的角向离散度,发现更高的语义均匀性(即嵌入更分散)意味着样本间事实一致性更低。该方法无需标注数据、无需微调、无需超参数调整,可适配开放或封闭权重嵌入模型。在多个领域中,仅用少量样本即可持续优于现有聚合信任信号,提供一种实用、低成本的初步可信度判断,可与逐条验证协同用于真实世界的大模型工作流。

原文摘要 · Abstract (English)

To deploy large language models (LLMs) in high-stakes application domains that require substantively accurate responses to open-ended prompts, we need reliable, computationally inexpensive methods that assess the trustworthiness of long-form responses generated by LLMs. However, existing approaches often rely on claim-by-claim fact-checking, which is computationally expensive and brittle in long-form responses to open-ended prompts. In this work, we introduce semantic isotropy -- the degree of uniformity across normalized text embeddings on the unit sphere -- and use it to assess the trustworthiness of long-form responses generated by LLMs. To do so, we generate several long-form responses, embed them, and estimate the level of semantic isotropy of these responses as the angular dispersion of the embeddings on the unit sphere. We find that higher semantic isotropy -- that is, greater embedding dispersion -- reliably signals lower factual consistency across samples. Our approach requires no labeled data, no fine-tuning, and no hyperparameter selection, and can be used with open- or closed-weight embedding models. Across multiple domains, our method consistently outperforms existing aggregate trust signals in predicting nonfactuality using only a handful of samples, offering a practical, low-cost first-pass signal that complements claim-level verification in real-world LLM workflows.

可信度评估语义均匀性生成质量大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。