通过极性感知探针检测语言模型内部对齐程度,揭示其潜在偏见的稳定性。
Polarity-Aware Probing for Quantifying Latent Alignment in Language Models
- 提出极性感知探针(PA-CCS),检验模型在语义反转下的内部一致性。
- 发现16个模型中存在架构与层级差异,部分模型对否定词替换敏感。
- 适合关注模型对齐与可解释性评估的研究者使用。
无监督探针如对比一致搜索(CCS)能揭示模型内部信念而无需依赖输出标记,但其是否可靠评估模型对齐仍待验证。本文通过分析CCS对有害与安全语句的敏感性,并引入极性感知CCS(PA-CCS),评估模型在极性反转下内部表示的一致性。提出两个对齐导向指标:极性一致性与矛盾指数,用于量化模型隐含知识的语义鲁棒性。构建了两个主数据集及一个控制数据集,包含通过不同方法生成的匹配有害-安全句子对(并行与对抗性陈述)。对16个语言模型应用PA-CCS,结果显示其能识别出架构与层级间的有害知识编码差异。值得注意的是,对内部对齐良好的模型,用无意义标记替换否定词会显著降低PA-CCS得分;而对缺乏鲁棒校准的模型则无此现象。研究凸显无监督探针在对齐评估中的潜力,并强调需将结构鲁棒性检查纳入可解释性基准。代码与数据集详见:https://github.com/SadSabrina/polarity-probing。警告:本文含可能敏感、有害或冒犯内容。
原文摘要 · Abstract (English)
Advances in unsupervised probes such as Contrast-Consistent Search (CCS), which reveal latent beliefs without relying on token outputs, raise the question of whether these methods can reliably assess model alignment. We investigate this by examining the sensitivity of CCS to harmful vs. safe statements and by introducing Polarity-Aware CCS (PA-CCS), a method for evaluating whether a model's internal representations remain consistent under polarity inversion. We propose two alignment-oriented metrics, Polar-Consistency and the Contradiction Index, to quantify the semantic robustness of a model's latent knowledge. To validate PA-CCS, we curate two main datasets and one control dataset containing matched harmful-safe sentence pairs constructed using different methodologies (concurrent and antagonistic statements). We apply PA-CCS to 16 language models. Our results show that PA-CCS identifies both architectural and layer-specific differences in the encoding of latent harmful knowledge. Notably, replacing the negation token with a meaningless marker degrades PA-CCS scores for models with well-aligned internal representations, while models lacking robust internal calibration do not exhibit this degradation. Our findings highlight the potential of unsupervised probing for alignment evaluation and emphasize the need to incorporate structural robustness checks into interpretability benchmarks. Code and datasets are available at: https://github.com/SadSabrina/polarity-probing. WARNING: This paper contains potentially sensitive, harmful, and offensive content.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。