arXiv:2601.15652cs.AIcs.CR2026-01

用脑科学启发的信号检测大模型幻觉,轻量高效且可解释。

Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models

  • 结合预测编码与信息瓶颈,提取可解释的幻觉信号。
  • 在HaluBench上达到0.8669 AUROC,比基线提升4.95%。
  • 仅需200样本训练,推理快500倍,适合生产部署。

大语言模型的幻觉(看似合理但事实错误的生成)仍是高风险应用的主要障碍。现有检测方法依赖计算开销大的外部检索或参数超700亿的黑箱判别器。本文提出[Model Name],一种融合神经科学启发信号与监督学习的混合检测框架。通过提取基于预测编码(量化对内部先验的意外程度)和信息瓶颈(测量扰动下的信号保留度)的可解释信号,系统性验证了三项改进:实体聚焦吸收(关注高价值词元)、上下文依附性(衡量生成根基强度)、可证伪性评分(识别自信但矛盾的陈述)。在200个样本、完全平衡的HaluBench数据集上,理论引导基线达0.8017 AUROC;监督模型提升至0.8274,使用优化特征后进一步达到0.8669 AUROC(提升4.95%),且跨多种架构表现一致。该性能以75倍更少训练数据(200 vs 15,000)、1000倍更快推理速度(5ms vs 5s)实现,并保持完全可解释性。关键发现:理性化信号无法区分幻觉,表明大模型会为错误前提生成连贯推理(“奉承现象”)。本工作证明,嵌入信号架构中的领域知识比扩大判别器规模更具数据效率,可实现轻量(<100万参数)、可解释的强性能模型,适用于生产环境。

原文摘要 · Abstract (English)

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external retrieval loops or opaque black-box LLM judges requiring 70B+ parameters. In this work, we introduce [Model Name], a hybrid detection framework that combines neuroscience-inspired signal design with supervised machine learning. We extract interpretable signals grounded in Predictive Coding (quantifying surprise against internal priors) and the Information Bottleneck (measuring signal retention under perturbation). Through systematic ablation, we demonstrate three key enhancements: Entity-Focused Uptake (concentrating on high-value tokens), Context Adherence (measuring grounding strength), and Falsifiability Score (detecting confident but contradictory claims). Evaluating on HaluBench (n=200, perfectly balanced), our theory-guided baseline achieves 0.8017 AUROC. BASE supervised models reach 0.8274 AUROC, while IMPROVED features boost performance to 0.8669 AUROC (4.95% gain), demonstrating consistent improvements across architectures. This competitive performance is achieved while using 75x less training data than Lynx (200 vs 15,000 samples), 1000x faster inference (5ms vs 5s), and remaining fully interpretable. Crucially, we report a negative result: the Rationalization signal fails to distinguish hallucinations, suggesting that LLMs generate coherent reasoning for false premises ("Sycophancy"). This work demonstrates that domain knowledge encoded in signal architecture provides superior data efficiency compared to scaling LLM judges, achieving strong performance with lightweight (less than 1M parameter), explainable models suitable for production deployment.

幻觉检测可解释性轻量模型预测编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。