arXiv:2509.17932cs.CL2025-09KDD

发现大模型中少数神经元向量能无训练检测事实错误,效果优于现有方法。

Training-free Truthfulness Detection via Sparse MLP Value Vectors

  • 从海量神经元向量中筛选出稀疏但稳定的少数关键向量,用于判断内容真假。
  • 在2B到13B模型上验证,相比已有无训练方法提升检测准确率。
  • 无需额外参数或训练,仅用小样本即可定位有效信号,适合快速部署。

大语言模型容易生成不实内容,需通过内部信号评估其真实性。尽管监督探测方法有效,但需标注数据和训练分类器。近期无训练方法虽避免优化,却依赖粗粒度激活统计,难以揭示真伪信号的生成机制。本文提出无需训练的TruthV方法,聚焦于多层感知机(MLP)值向量的个体层面。系统分析发现,多数值向量无意义,但少数稀疏向量表现出稳定且方向一致的真实相关性。基于此,我们设计了仅依赖小支持集即可识别相关向量的聚合推理方法,不引入额外参数或分类权重。在2B至13B模型规模及多个基准测试(问答、自然语言理解、幻觉评估)中,TruthV持续优于现有无训练基线,表明大模型中的真伪差异以稀疏结构化方式存在于MLP值向量层面。

原文摘要 · Abstract (English)

Large language models (LLMs) are prone to generating factually incorrect content, motivating methods for assessing truthfulness from internal model signals. While supervised probing approaches can be effective, they require labeled data and classifier training. Recent training-free methods avoid parameter optimization but rely on coarse activation statistics that provide limited insight into how truthfulness-related signals arise within the model. We present a training-free approach that operates at the level of individual multi-layer perceptron (MLP) value vectors. Through a systematic analysis, we find that although most value vectors show no meaningful signal, a sparse subset exhibits stable and directionally consistent correlations with content truthfulness. Leveraging this observation, we propose \textbf{TruthV}, a simple inference method that aggregates preferences expressed by these value vectors. TruthV requires only a small support set to identify relevant vectors and introduces no additional model parameters or classifier weights. We evaluate TruthV across model scales from 2B to 13B and multiple benchmarks, including question answering, natural language understanding, and hallucination evaluation. TruthV consistently outperforms existing training-free baselines, demonstrating that truthfulness-related variation in LLMs is captured in a sparse and structured manner at the level of MLP value vectors.

大模型真伪检测无训练稀疏向量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。