arXiv:2504.20902cs.CVcs.AI2025-04CVPR被引 5

无需标注数据,自动发现视觉模型隐含偏见。

Classifier-to-Bias: Toward Unsupervised Automatic Bias Detection for Visual Classifiers

  • 用文本描述触发大模型生成偏见假设和带偏见的图像提示
  • 通过检索获取偏见相关图像,评估模型在偏见下的准确率下降
  • 适用于任何预训练模型,无需训练或人工标注

从网络下载预训练模型的人应了解其潜在偏见。现有偏见识别方法依赖于特定任务的标注数据,非专家难以获取或收集,极大限制了可检测任务范围。本文提出 Classifier-to-Bias(C2B),首个无需任何标注数据的偏见发现框架:仅需分类任务的文本描述,通过大语言模型生成偏见假设与对应图像提示,再利用检索模型获取相关图像,用于评估模型在偏见条件下的表现。C2B无需训练、无标注依赖、不限制偏见类型,可应用于任意预训练分类模型和任务。在两个公开数据集上的实验表明,C2B能发现原始数据集中未包含的偏见,且优于依赖任务标注的最新基线方法,是实现任务无关无监督偏见检测的重要一步。

原文摘要 · Abstract (English)

A person downloading a pre-trained model from the web should be aware of its biases. Existing approaches for bias identification rely on datasets containing labels for the task of interest, something that a non-expert may not have access to, or may not have the necessary resources to collect: this greatly limits the number of tasks where model biases can be identified. In this work, we present Classifier-to-Bias (C2B), the first bias discovery framework that works without access to any labeled data: it only relies on a textual description of the classification task to identify biases in the target classification model. This description is fed to a large language model to generate bias proposals and corresponding captions depicting biases together with task-specific target labels. A retrieval model collects images for those captions, which are then used to assess the accuracy of the model w.r.t. the given biases. C2B is training-free, does not require any annotations, has no constraints on the list of biases, and can be applied to any pre-trained model on any classification task. Experiments on two publicly available datasets show that C2B discovers biases beyond those of the original datasets and outperforms a recent state-of-the-art bias detection baseline that relies on task-specific annotations, being a promising first step toward addressing task-agnostic unsupervised bias detection.

模型偏见无监督学习大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。