arXiv:2509.00096cs.LGcs.CL2025-09EMNLP被引 5

pruning 会破坏大模型的说谎检测能力,新方法保真剪枝。

Pruning Weights but Not Truth: Safeguarding Truthfulness While Pruning LLMs

  • 按层异常值强度调整剪枝策略,保护关键判谎特征
  • 50%压缩率下说谎检测准确率达88%,优于原有方法
  • 适合需保障生成内容真实性的低资源部署场景

神经网络剪枝为在低资源环境下部署大语言模型提供了可行路径,同时保持下游任务性能。然而,我们首次发现,此类剪枝会破坏大模型内部用于谎言检测的关键激活特征——这些特征通常通过小规模逻辑回归分类器进行探测。这引发一个关键问题:如何在剪枝的同时不牺牲大模型的谎言检测能力?进一步研究发现,仅依据重要性调整分层剪枝稀疏度会误删关键权重,导致谎言检测性能未提升,尽管该策略依赖于最关键的模型层。为此,我们提出基于层异常值对齐的保真剪枝(TPLO),重点关注具有更多激活异常值且判别性更强的层,从而在保留原始性能的同时,维持内态中对鲁棒谎言检测至关重要的特征。此外,我们引入一种提示规则以丰富TruthfulQA基准,实现更精准的大模型剪枝校准。实验结果表明,该方法在剪枝后的模型中显著提升了幻觉检测能力(50%稀疏度下达到88%准确率),并增强了其在TruthfulQA上的表现。

原文摘要 · Abstract (English)

Neural network pruning has emerged as a promising approach for deploying LLMs in low-resource scenarios while preserving downstream task performance. However, for the first time, we reveal that such pruning disrupts LLMs' internal activation features crucial for lie detection, where probing classifiers (typically small logistic regression models) trained on these features assess the truthfulness of LLM-generated statements. This discovery raises a crucial open question: how can we prune LLMs without sacrificing these critical lie detection capabilities? Our investigation further reveals that naively adjusting layer-wise pruning sparsity based on importance inadvertently removes crucial weights, failing to improve lie detection performance despite its reliance on the most crucial LLM layer. To address this issue, we propose Truthful Pruning aligned by Layer-wise Outliers (TPLO), which places greater emphasis on layers with more activation outliers and stronger discriminative features simultaneously. This preserves LLMs' original performance while retaining critical features of inner states needed for robust lie detection. Moreover, we introduce a prompting rule to enrich the TruthfulQA benchmark for better calibrating LLM pruning. Empirical results show that our approach improves the hallucination detection for pruned LLMs (achieving 88% accuracy at 50% sparsity) and enhances their performance on TruthfulQA.

大模型剪枝真相检测模型压缩可信生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。