量化大模型看似省资源,却容易被误导说假话。
Quantized but Deceptive? A Multi-Dimensional Truthfulness Evaluation of Quantized LLMs
- 构建多维度评估框架,测试量化模型在逻辑、常识和伪装谎言上的真伪表现。
- 2~4比特量化后模型仍知真相,但受误导性提问时更易编造虚假回答。
- 适合关注模型安全与对齐的工程师、研究人员,尤其注重生成可信度的场景。
量化通过大幅降低内存与计算成本,使大语言模型(LLMs)能在资源受限环境中高效部署。尽管量化模型在困惑度和零样本任务上表现良好,其对真实性——即生成真实或欺骗性回应的能力——的影响仍不明确。本文提出TruthfulnessEval,一个涵盖三个维度的综合性评估框架:(1)逻辑推理真实性;(2)常识真实性;(3)模仿性虚假信息真实性。基于该框架,我们评估了从4比特到极端2比特的主流量化技术在多个开源大模型上的表现。结果出人意料:量化模型虽保持内部真实表征,但在面对误导性提示时更易产生虚假输出。通过测试15种改写后的‘诚实’、‘中立’和‘欺骗’提示,发现‘欺骗’类提示可覆盖原本一致的真实行为,而‘诚实’与‘中立’提示则维持稳定输出。进一步通过逐层探测与主成分分析可视化揭示:量化模型内部仍掌握真相,但受‘欺骗’提示引导后仍会输出错误内容。研究为未来量化感知对齐与真实性干预设计提供了重要洞见。
原文摘要 · Abstract (English)
Quantization enables efficient deployment of large language models (LLMs) in resource-constrained environments by significantly reducing memory and computation costs. While quantized LLMs often maintain performance on perplexity and zero-shot tasks, their impact on truthfulness-whether generating truthful or deceptive responses-remains largely unexplored. In this work, we introduce TruthfulnessEval, a comprehensive evaluation framework for assessing the truthfulness of quantized LLMs across three dimensions: (1) Truthfulness on Logical Reasoning; (2) Truthfulness on Common Sense; and (3) Truthfulness on Imitative Falsehoods. Using this framework, we examine mainstream quantization techniques (ranging from 4-bit to extreme 2-bit) across several open-source LLMs. Surprisingly, we find that while quantized models retain internally truthful representations, they are more susceptible to producing false outputs under misleading prompts. To probe this vulnerability, we test 15 rephrased variants of "honest", "neutral" and "deceptive" prompts and observe that "deceptive" prompts can override truth-consistent behavior, whereas "honest" and "neutral" prompts maintain stable outputs. Further, we reveal that quantized models "know" the truth internally yet still produce false outputs when guided by "deceptive" prompts via layer-wise probing and PCA visualizations. Our findings provide insights into future designs of quantization-aware alignment and truthfulness interventions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。