arXiv:2605.24919cs.CL2026-05被引 3

无需微调,通过分析大模型隐藏状态实现多语言幻觉检测。

MultiHaluDet: Multilingual Hallucination Detection via LLM Hidden State Probing

论文配图:MultiHaluDet: Multilingual Hallucination Detection via LLM Hidden State Probing
图 1 · 摘自论文原文
  • 通过探测冻结大模型的全层隐藏状态轨迹提取特征。
  • 在英文数据集上最高达98.55% AUROC,跨语言性能优异。
  • 适合关注多语言幻觉检测与模型可解释性的研究者。

大型语言模型中的幻觉是其可靠部署的关键障碍,尤其在非英语和资源匮乏场景下更为严重。现有方法依赖输出置信度启发式或单层内部表示,难以捕捉跨多种语言的深层事实矛盾。为此,我们提出MultiHaluDet,一种无需语言特定微调的三阶段堆叠框架,通过探测冻结大模型的完整隐藏状态轨迹来检测多语言幻觉。该方法在多层中提取序列特征,并采用多尺度注意力与自注意力池化相结合的混合架构进行处理。通过生成留出样本嵌入并输入校准后的经典分类器集成,能够捕捉细粒度与粗粒度的事实不一致模式。大量实验表明,该框架在English HaluEval与TriviaQA基准上,使用Mistral-7B和LLaMA2-7B模型时达到最高98.55% AUROC。关键的是,我们在高资源(法语)、中等资源(孟加拉语)和低资源(阿姆哈拉语)语言上严格评估了跨语言泛化能力。MultiHaluDet展现出卓越的表征鲁棒性,持续优于基线,并成功在类型多样的语言层级间迁移幻觉检测能力。

原文摘要 · Abstract (English)

Hallucinations in Large Language Models (LLMs) represent a critical barrier to their reliable deployment, a vulnerability heavily exacerbated in non-English and resource-constrained contexts. Existing detection approaches that rely on output confidence heuristics or single-layer internal representations frequently fail to capture deep, complex factual inconsistencies across diverse languages. To address this, we introduce MultiHaluDet, a novel three-stage stacking framework that detects multilingual hallucinations by probing the full hidden state trajectories of frozen LLMs without requiring language-specific fine-tuning. Our method extracts sequential features across multiple layers and processes them via a hybrid architecture using multi-scale attention and self-attention pooling. By generating out-of-fold embeddings that feed into a calibrated classical classifier ensemble, MultiHaluDet captures both fine-grained and coarse-grained patterns of factual inconsistency. Extensive experiments demonstrate that our framework achieves state-of-the-art detection performance, reaching up to 98.55% AUROC on the English HaluEval and TriviaQA benchmarks using Mistral-7B and LLaMA2-7B architectures. Crucially, we rigorously evaluate our framework's cross-lingual generalization across high (French), medium (Bangla), and low-resource (Amharic) languages. MultiHaluDet demonstrates exceptional representational robustness, consistently outperforming baselines and successfully transferring hallucination detection capabilities across typologically diverse linguistic tiers.

幻觉检测多语言大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。