通过分析模型权重空间,揭示隐藏的虚假关联,提升大模型可信度。
Bridging Explainability and Embeddings: BEE Aware of Spuriousness
- 从权重空间和嵌入几何角度诊断虚假关联,不依赖错误样本。
- 在多个数据集上发现使ImageNet准确率下降95%的虚假特征。
- 适用于视觉、医疗文本等多领域,适合模型审计与可信AI研究者。
现有检测虚假相关性的方法依赖数据统计或错误模式,当反例缺失时难以发现有害捷径。我们提出BEE(Bridging Explainability and Embeddings)框架,将关注点从模型预测转向权重空间及决策背后的嵌入几何结构。通过分析微调对预训练表示的影响,BEE揭示了传统评估流程无法捕捉的虚假相关性。采用线性探测作为透明诊断工具,发现这些虚假特征不仅在全量微调后仍存在,还能跨多种先进模型迁移。实验覆盖多个数据集与领域:视觉(Waterbirds、CelebA、ImageNet-1k)、语言(CivilComments、MIMIC-CXR医学笔记),以及多种嵌入模型(CLIP、CLIP-DataComp.XL、mGTE、BLIP2、SigLIP2)。BEE持续暴露虚假相关性:如导致ImageNet准确率下降高达95%的概念,以及在MIMIC-CXR笔记中引发危险假阴性的临床捷径。结果表明,BEE是一种通用且原理清晰的权重空间诊断工具,可用于数据集审计与构建更可信的基础模型。代码已公开于https://github.com/bit-ml/bee。
原文摘要 · Abstract (English)
Current methods for detecting spurious correlations rely on analyzing dataset statistics or error patterns, leaving many harmful shortcuts invisible when counterexamples are absent. We introduce BEE (Bridging Explainability and Embeddings), a framework that shifts the focus from model predictions to the weight space, and to the embedding geometry underlying decisions. By analyzing how fine-tuning perturbs pretrained representations, BEE uncovers spurious correlations that remain hidden from conventional evaluation pipelines. We use linear probing as a transparent diagnostic lens, revealing spurious features that not only persist after full fine-tuning but also transfer across diverse state-of-the-art models. Our experiments cover numerous datasets and domains: vision (Waterbirds, CelebA, ImageNet-1k), language (CivilComments, MIMIC-CXR medical notes), and multiple embedding families (CLIP, CLIP-DataComp.XL, mGTE, BLIP2, SigLIP2). BEE consistently exposes spurious correlations: from concepts that slash the ImageNet accuracy by up to 95%, to clinical shortcuts in MIMIC-CXR notes that induce dangerous false negatives. Together, these results position BEE as a general and principled tool for diagnosing spurious correlations in weight space, enabling principled dataset auditing and more trustworthy foundation models. The source code is publicly available at https://github.com/bit-ml/bee.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。