用量子张量网络量化大模型幻觉的语义不确定性,提升生成可靠性。
Semantic Uncertainty Quantification of Hallucinations in LLMs: A Quantum Tensor Network Based Method
- 基于量子张量网络构建语义等价聚类,量化输出的随机性不确定性。
- 在116组实验中,对多个模型和数据集的检测性能优于现有方法。
- 适合关注生成可信度、需人机协作的AI系统研发者使用。
大语言模型虽具强大生成能力,但易产生流利却不可靠的幻觉输出。本文提出一种受量子物理启发的不确定性量化框架,利用量子张量网络管道,对令牌序列概率中的偶然不确定性进行建模,实现基于语义等价的生成聚类,提供可解释的幻觉检测方案。进一步引入熵最大化策略,优先选择高确定性、语义一致的输出,并标识出模型决策不可靠的熵值区域,为人工干预提供依据。我们在不同生成长度与量化级别下评估该方法的鲁棒性,覆盖以往研究忽略的维度,证明其在资源受限部署中依然可靠。在TriviaQA、NQ、SVAMP和SQuAD上,针对Mistral-7B、Mistral-7B-instruct、Falcon-rw-1b、LLaMA-3.2-1b、LLaMA-2-13b-chat、LLaMA-2-7b-chat、LLaMA-2-13b及LLaMA-2-7b等多架构共116组实验显示,本方法在AUROC和AURAC指标上持续优于当前最优基线。
原文摘要 · Abstract (English)
Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based pipeline, we propose a quantum physics inspired uncertainty quantification framework that accounts for aleatoric uncertainty in token sequence probability for semantic equivalence based clustering of LLM generations. This offers a principled and interpretable scheme for hallucination detection. We further introduce an entropy maximization strategy that prioritizes high certainty, semantically coherent outputs and highlights entropy regions where LLM decisions are likely to be unreliable, offering practical guidelines for when human oversight is warranted. We evaluate the robustness of our scheme under different generation lengths and quantization levels, dimensions overlooked in prior studies, demonstrating that our approach remains reliable even in resource constrained deployments. A total of 116 experiments on TriviaQA, NQ, SVAMP, and SQuAD across multiple architectures including Mistral-7B, Mistral-7B-instruct, Falcon-rw-1b, LLaMA-3.2-1b, LLaMA-2-13b-chat, LLaMA-2-7b-chat, LLaMA-2-13b, and LLaMA-2-7b show consistent improvements in AUROC and AURAC over state of the art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。