arXiv:2604.19974cs.LGcs.CL2026-04被引 4

发现大模型的正确性与不确定性由不同特征驱动,可分离干预提升性能。

Are LLM Uncertainty and Correctness Encoded by the Same Features? A Functional Dissociation via Sparse Autoencoders

论文配图:Are LLM Uncertainty and Correctness Encoded by the Same Features? A Functional Dissociation via Sparse Autoencoders
图 1 · 摘自论文原文
  • 用稀疏自编码器分离出四类特征:纯不确定、纯错误、混淆型等
  • 抑制混淆特征使准确率提升1.1%,熵降75%,跨基准有效
  • 仅3个混淆特征即可预测正确性,支持精准拒答,准确率从62%升至81%

大型语言模型可能既不确定又正确,或既自信又错误,这引发疑问:其输出层面的不确定性与实际正确性是否由相同内部机制驱动。本文提出一个2×2框架,沿正确性与置信度轴划分模型预测,并使用稀疏自编码器独立识别各维度相关特征。在Llama-3.1-8B和Gemma-2-9B上,我们识别出三类功能迥异的特征群体:纯不确定性特征具有功能性必要性,抑制会严重降低准确率;纯错误性特征功能惰性,尽管在正确/错误预测间激活差异显著,但抑制后对准确率影响几乎为零;混淆特征同时编码两种信号,有害于输出质量,针对性抑制可带来1.1%的准确率提升和75%的熵减少,且效果在ARC-Challenge与RACE基准间迁移。这些特征类别在信息上也彼此独立:仅需单层中3个混淆特征的激活即可预测模型正确性(AUROC ~0.79),实现选择性拒答,在53%覆盖下将准确率从62%提升至81%。结果表明,不确定性与正确性是内部不同的现象,对可解释性与推理时干预有重要启示。

原文摘要 · Abstract (English)

Large language models can be uncertain yet correct, or confident yet wrong, raising the question of whether their output-level uncertainty and their actual correctness are driven by the same internal mechanisms or by distinct feature populations. We introduce a 2x2 framework that partitions model predictions along correctness and confidence axes, and uses sparse autoencoders to identify features associated with each dimension independently. Applying this to Llama-3.1-8B and Gemma-2-9B, we identify three feature populations that play fundamentally different functional roles. Pure uncertainty features are functionally essential: suppressing them severely degrades accuracy. Pure incorrectness features are functionally inert: despite showing statistically significant activation differences between correct and incorrect predictions, the majority produce near-zero change in accuracy when suppressed. Confounded features that encode both signals are detrimental to output quality, and targeted suppression of them yields a 1.1% accuracy improvement and a 75% entropy reduction, with effects transferring across the ARC-Challenge and RACE benchmarks. The feature categories are also informationally distinct: the activations of just 3 confounded features from a single mid-network layer predict model correctness (AUROC ~0.79), enabling selective abstention that raises accuracy from 62% to 81% at 53% coverage. The results demonstrate that uncertainty and correctness are distinct internal phenomena, with implications for interpretability and targeted inference-time intervention.

大模型可解释性特征解耦推理优化稀疏编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。