arXiv:2607.21063cs.CLcs.CY2026-07

量化让大模型悄悄变偏,即便通过常规安全测试仍会输出刻板印象。

QuantiBias: Benchmarking Quantization-Induced Bias in LLMs

论文配图:QuantiBias: Benchmarking Quantization-Induced Bias in LLMs
图 1 · 摘自论文原文
  • 用多语言开放生成任务检测量化引入的隐性偏见
  • 量化后约24%~27%的回答含刻板印象,远超安全测试容忍度
  • 适合关注模型公平性与部署风险的研究者和工程师

几乎所有面向大众的大语言模型都会经过量化压缩:先以全精度训练,再为效率降维。这一过程通常被视为无害,安全性极少重新验证。我们发现其主要副作用是加剧偏见,而标准安全评估无法捕捉。在模型、训练数据和提示固定的情况下,量化模型仍能拒绝有害请求、避免过度拒绝良性提示,并选择无偏的多选答案。但当被问及开放式问题时,同一模型在八种语言中均主动输出刻板印象,独立评判下约四分之一回答(24%至27%)包含偏见,跨越不同压缩层级。该偏差现象稳定存在;而开放生成偏见是否随压缩程度进一步上升尚不确定,受评分者影响较大。为此我们提出「QuantiBias」基准,结合生成式多语言刻板印象探测器,与拒绝行为及多选控制并行,区分有无推理前处理,评估生成内容严重性。在两个基础模型(Qwen与Gemma)、五个量化家族和八个基准上,量化器将额外精度分配给无偏见预防信号的能力数据,且推理前置可使部分家族偏见减半,另一些则无影响。量化版本必须重新评估开放生成偏见,不能仅依赖已通过的短格式安全测试。

原文摘要 · Abstract (English)

Almost every large language model that reaches a broad audience is quantized: trained in full precision, then compressed for efficiency. This step is assumed harmless and its safety is rarely re-checked. We find its principal side effect is increased bias that standard safety evaluation misses. Holding the model, its training, and the prompts fixed, a quantized model still refuses harmful requests, still avoids over-refusing benign prompts, and still selects the unbiased multiple-choice answer. Yet asked an open-ended question, the same model volunteers stereotypes in all eight languages we probe, in roughly one in four open-ended answers under an independent judge (~24% to ~27% across the compression ladder): it passes every standard check and still reaches users measurably more biased. The selective gap is a robust finding; whether open-ended bias further increases with compression is less certain, sensitive to the judge that scores it. We address both with \textbf{QuantiBias}, a benchmark that pairs a generative, multilingual stereotype probe with the refusal and multiple-choice controls that isolate open-ended generation, contrasts each build with and without reasoning, and rates the content severity of what it generates. Across two backbone models (Qwen and Gemma), a five-family screen, and eight benchmarks, quantizers allocate their extra precision by capability data that carries no bias-prevention signal, and reasoning before answering roughly halves the effect on some families while doing nothing on others. A quantized build must be re-evaluated for open-ended bias, not only on the short-form safeguards it already passes.

大模型量化偏见检测公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。