arXiv:2605.27706cs.CLcs.IR2026-05被引 1

用语义一致性动态修正大模型输出,减少幻觉

Chain-based Adaptive Reconfiguration Over Lattices for Hallucination Reduction

论文配图:Chain-based Adaptive Reconfiguration Over Lattices for Hallucination Reduction
图 1 · 摘自论文原文
  • 基于语义一致性构建文本序列的格结构,定义可优化目标
  • 在问答与多智能体推理任务中幻觉率下降37%以上
  • 适合需要高可靠性输出的对话系统与知识推理场景

我们提出CAROL(Chain-based Adaptive Reconfiguration Over Lattices),一种用于大语言模型测试时幻觉抑制的概率框架。不同于依赖词元级不确定性的方法,CAROL基于生成结果与可信上下文的一致性定义语义不确定性,构建文本序列格上的子模优化目标。该形式使幻觉缓解转化为具有可证明收敛性和近优保证的马尔可夫链接受-拒绝过程,支持模型迭代优化输出以实现语义一致。通过语义层面操作,CAROL统一了幻觉检测与缓解机制。在问答和多智能体推理基准上的实证结果表明,相比基于似然和检索增强的基线方法,CAROL显著降低幻觉率,提升可靠性和可解释性,同时保持竞争性计算效率。

原文摘要 · Abstract (English)

We introduce CAROL (Chain-based Adaptive Reconfiguration Over Lattices), a probabilistic framework for test-time hallucination reduction in large language models. Rather than relying on token-level uncertainty, CAROL defines a semantic uncertainty measure based on the consistency between generated responses and a trusted context, inducing a string-submodular objective over a lattice of textual sequences. This formulation enables hallucination mitigation to be cast as a Markov chain accept-reject process with provable convergence and near-optimality guarantees, allowing the model to iteratively refine outputs toward semantic consistency. By operating at the level of meaning, CAROL unifies hallucination detection and mitigation within a single framework. Empirical results on question answering and multi-agent reasoning benchmarks show that CAROL significantly reduces hallucinations and improves reliability and interpretability compared to likelihood-based and retrieval-augmented baselines, while maintaining competitive computational efficiency.

幻觉抑制语义一致性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。