arXiv:2509.22449cs.CL2025-09Conference of the …被引 11

通过激活空间方向检测大模型无法回答的问题,提升可信度。

Detecting (Un)answerability in Large Language Models with Linear Directions

  • 在模型激活空间找一个方向,判断问题是否可答。
  • 在4个数据集上准确率超现有方法,且跨数据集泛化更强。
  • 适用于科学共识缺失等复杂不可答场景,可调控模型拒绝回答行为。

大型语言模型常在缺乏信息时仍自信作答,导致幻觉。本文研究提取式问答中的(不可)回答性检测,提出一种简单方法:通过推理时添加激活并测量对模型回避行为的影响,识别出能捕捉不可回答性的激活空间方向。将隐藏层激活投影到该方向可得到可靠的分类得分。在两个开源大模型和四个提取式问答基准上的实验表明,该方法能有效检测不可回答问题,且跨数据集泛化能力优于现有提示法与分类器方法。此外,该方向还可推广至因科学共识缺失或主观性导致的不可回答情形。因果干预实验显示,增删该方向可有效控制模型的回避行为。

原文摘要 · Abstract (English)

Large language models (LLMs) often respond confidently to questions even when they lack the necessary information, leading to hallucinated answers. In this work, we study the problem of (un)answerability detection, focusing on extractive question answering (QA) where the model should determine if a passage contains sufficient information to answer a given question. We propose a simple approach for identifying a direction in the model's activation space that captures unanswerability and uses it for classification. This direction is selected by applying activation additions during inference and measuring their impact on the model's abstention behavior. We show that projecting hidden activations onto this direction yields a reliable score for (un)answerability classification. Experiments on two open-weight LLMs and four extractive QA benchmarks show that our method effectively detects unanswerable questions and generalizes better across datasets than existing prompt-based and classifier-based approaches. Moreover, the obtained directions extend beyond extractive QA to unanswerability that stems from factors, such as lack of scientific consensus and subjectivity. Last, causal interventions show that adding or ablating the directions effectively controls the abstention behavior of the model.

大模型问答系统可解释性检测机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。