通过分析模型参数更新方向差异,提升大模型幻觉检测的鲁棒性。
AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models

- 利用参数梯度动态差异区分幻觉与真实输出
- 在4个模型族、4个数据集上实现强检测效果
- 适用于数学推理和图文任务等跨领域场景
大型语言模型在自然语言处理任务中表现卓越,但其生成幻觉(事实错误或不忠实输出)的问题严重制约了其在高风险场景的应用。现有检测方法多依赖昂贵的输出一致性检查或静态隐藏状态探针,难以在跨数据集评估中保持性能。本文提出AURORA框架,将焦点从静态表征转向模型权重梯度动态。核心洞察是:幻觉与真实回答会引发参数更新模式的质变差异。具体表现为幻觉样本触发非对称且结构错位的梯度,可通过两个互补特征捕捉:(1) 权重矩阵与梯度更新方向间余弦相似度分布的偏度;(2) 通过SVD量化梯度更新对权重矩阵奇异向量基的旋转比例。AURORA在四个模型族和四个基准数据集上均表现优异。进一步分析表明,该方法在不同模型规模下可有效扩展,并能迁移至数学推理和视觉-语言等域外任务。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to generate hallucinations, namely factually incorrect or unfaithful outputs, poses a critical obstacle to their deployment in high-stakes applications. Although recent hallucination detection methods have made encouraging progress, they typically rely on costly output-level consistency checks or static hidden-state probes that capture shallow dataset-specific patterns, leading to substantial degradation under cross-dataset evaluation. In this work, we propose AURORA, a novel hallucination detection framework that shifts the focus from static representations to the weight-gradient dynamics of LLMs. Our key insight is that hallucinated and faithful answers induce qualitatively different gradient update patterns on the model's parameters. Specifically, hallucinated samples trigger asymmetric and structurally misaligned gradients, which can be captured through two complementary features: (1) the skewness of the cosine similarity distribution between weight matrices and their gradient update directions, and (2) the rotation ratio, which quantifies how much the gradient update reorients the singular-vector basis of weight matrices via SVD. AURORA achieves strong hallucination detection performance across four model families and four benchmark datasets. Further analyses demonstrate that our method scales effectively across model sizes and transfers to out-of-domain tasks, including mathematical reasoning and vision-language scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。