arXiv:2607.01208cs.CLcs.AI2026-07中稿 · ICML

通过蒸馏隐性偏见,让大模型的隐蔽偏好显形。

Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation

论文配图:Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation
图 1 · 摘自论文原文
  • 用卡槽蒸馏法将模型偏见集中放大,生成可检测文本。
  • 在多种偏见类型下均能可靠暴露隐藏偏好。
  • 适合用于审计部署中大模型的隐性行为。

在高风险场景中部署的语言模型可能对特定实体、品牌或观点存在偏好,从而大规模影响用户决策。这种偏好可能由模型供应链中任意环节引入,尤其危险的是:模型仅在相关话题上显露偏好,其他输入则与原始基础模型表现一致。近期研究发现,此类偏见可通过语义无关数据的上下文蒸馏传递,信号仅存在于软对数概率分布中,无法通过文本检查发现。但防御方面临根本不对称:未知偏见主题时,任何检测方法(包括生成文本、内部表示或权重分析)均难以可靠发现。本文提出 Distill to Detect (D2D),通过将疑似模型与基础模型之间的分布偏移蒸馏为一个卡槽(KV-cache前缀适配器),聚焦主导差异并放大偏见信号至生成文本。实验表明,D2D能有效放大各类隐蔽偏见,使其可被可靠检测。同时提出基于Fisher加权对数概率分布偏移投影的理论框架,支持实证观察。通过将前缀调优适配器的容量瓶颈转化为检测工具,D2D为审计已部署语言模型的隐性行为提供了实用组件。

原文摘要 · Abstract (English)

Language models deployed in high-stakes roles can potentially favor certain entities, brands, or viewpoints, steering user decisions at scale. Such preferential biases can be introduced by any actor in the model's supply chain and are most dangerous when the model reveals its preference only on the relevant topic while behaving identically to its unmodified base on all other inputs. Recent work has shown that these biases can transfer through context distillation on semantically unrelated data, with the signal residing entirely in the soft logit distribution and remaining invisible to text-based inspection. However, the defender faces a fundamental asymmetry: without knowing the bias topic, no detection method can reliably surface a stealth preferential bias, regardless of whether it examines generated text, internal representations, or model weights. Here we introduce Distill to Detect (D2D), a method that surfaces hidden biases by distilling the distributional shift between a suspected model and its base into a cartridge (a KV-cache prefix adapter), concentrating the dominant divergence and amplifying the bias signal into generated text. We show that D2D successfully amplifies the hidden biases of stealth models to the extent that they can be reliably detected across multiple bias types. We also propose a theoretical framework that explains the efficacy of D2D through the lens of Fisher-weighted projection of the logit distribution shift, supported by empirical observations. By turning the capacity bottleneck of prefix-tuning adapters into a detection tool, D2D provides a practical building block for auditing hidden behaviors in deployed language models.

大模型审计偏见检测蒸馏方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。