arXiv:2605.28450cs.CVcs.AI2026-05中稿 · The Web Conference…被引 1

无需训练即可自动检测并消除图像分类中的社会偏见。

BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers

论文配图:BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers
图 1 · 摘自论文原文
  • 通过视觉语言表征分析自动发现数据中的隐含偏见属性
  • 用文本引导图像编辑生成真实且无偏的样本,提升公平性
  • 不依赖人工标注,可直接使用现成模型,适合实际部署

网络图像数据驱动图像分类器,广泛应用于推荐和内容审核等服务。然而,原始网络数据常包含虚假关联和社会偏见,神经网络易学习这些偏差,导致服务系统持续强化不公平现象,形成恶性循环。在图像分类中,当某一类别多数图像共享同一属性时,模型会习得该类别的偏见特征。因此,从有偏数据中训练公平分类器需解决偏见对齐样本(占多数)与偏见冲突样本(占少数)之间的不平衡问题。本文提出BiasEdit,一种无需训练的模块化框架,可自动检测原始数据中的偏见属性并进行编辑以构建去偏数据集。具体而言,先通过视觉-语言表征的统计依赖性和互信息分析识别未知偏见属性,再利用文本引导图像编辑生成逼真的偏见冲突样本。相比以往依赖已知偏见或合成混合的方法,本方法无需人工标注,可调用现成的视觉-语言与编辑模型。该框架解决了源于网络数据的视觉人工智能根本挑战,在训练数据完全有偏的情况下仍实现顶尖去偏性能。

原文摘要 · Abstract (English)

Visual data from the Web power image classifiers, which often underpin many web services, such as recommendation and content moderation. However, the raw Web data often contain spurious correlations and social biases, and neural networks are known for their tendency to learn biases present in data. This can reinforce unfairness in web services and the web data, leading to a vicious cycle. In the context of image classification, networks learn bias attributes for a specific class when a majority of images contain the same attribute only for a given class. Hence, training a fair and debiased classifier from a biased dataset demands handling an imbalanced problem between a majority of images with bias attributes (bias-aligned samples) and a minority without (bias-conflict samples). In this work, we introduce BiasEdit, a modular framework that automatically detects bias attributes from the original dataset and edits them to construct a debiased dataset. Specifically, BiasEdit first detects unknown bias attributes via statistical dependence and mutual information analysis of visual-linguistic representations, and then explicitly edits those attributes using text-guided image editing to generate realistic bias-conflict samples. Unlike prior works that assume known bias attributes or relies on synthetic mixing, our method operates without manual annotations and can leverage off-the-shelf vision-language and editing models. BiasEdit addresses a fundamental challenge in Web-sourced visual AI, mitigating dataset-induced bias and achieving state-of-the-art debiasing performance even when training data are fully biased.

去偏视觉语言图像编辑公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。