arXiv:2605.14449cs.LGcs.AI2026-05

通过分离问题相关特征,提升大模型幻觉检测的准确率与跨域泛化能力。

When Answers Stray from Questions: Hallucination Detection via Question-Answer Orthogonal Decomposition

论文配图:When Answers Stray from Questions: Hallucination Detection via Question-Answer Orthogonal Decomposition
图 1 · 摘自论文原文
  • 将答案表示中与问题相关的部分投影去除,保留无关信息以抑制领域偏差
  • 在同域检测中达到最优AUROC,跨域迁移性能比最优基线高21%
  • 单次推理完成,生成成本低于基准方法的25%,适合高效部署

大语言模型的幻觉检测需兼顾准确性、效率和对分布偏移的鲁棒性。黑盒一致性方法有效但需多次推理;单次白盒探针虽高效,却孤立处理答案表示,易受领域变化影响。本文提出QAOD(问题-答案正交分解)框架,将答案表示中与问题对齐的方向投影出去,得到与问题正交的成分,从而抑制领域相关的变异。为识别有效信号,QAOD采用多样性惩罚的Fisher评分选择层,并通过Fisher重要性筛选判别性神经元。针对同域检测与跨域泛化,设计两种互补探测策略:将正交成分与问题上下文配对,提升同域判别力;仅使用正交成分,则保留无领域依赖的事实性信号以增强迁移能力。在所有评估的模型-数据集组合中,联合探测器取得最佳同域AUROC;正交成分单独使用时,跨域表现超越最优白盒基线,BioASQ上提升高达21%,且生成成本不足基线的25%。

原文摘要 · Abstract (English)

Hallucination detection in large language models (LLMs) requires balancing accu racy, efficiency, and robustness to distribution shift. Black-box consistency methods are effective but demand repeated inference; single-pass white-box probes are effi cient yet treat answer representations in isolation, often degrading sharply under domain shift. We propose QAOD (Question-Answer Orthogonal Decomposition), a single-pass framework that projects away the question-aligned direction from the answer representation to obtain a question-orthogonal component that suppresses domain-conditioned variation. To identify informative signals, QAOD further selects layers via diversity-penalized Fisher scoring and discriminative neurons via Fisher importance. To address both in-domain detection and cross-domain generalization, we design two complementary probing strategies: pairing the or thogonal component with question context yields a joint probe that maximizes in-domain discriminability, while using the orthogonal component alone preserves domain-agnostic factuality signals for robust transfer. QAOD's joint probe achieves the best in-domain AUROC across all evaluated model-dataset pairs, while the orthogonal-only probe delivers the strongest OOD transfer, surpassing the best white-box baseline by up to 21% on BioASQ at under 25% of generation cost.

幻觉检测正交分解跨域泛化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。