arXiv:2512.03749cs.CV2025-12中稿 · WACV 2026被引 2

无需标注数据,自动消除文本生成图像模型的偏见

Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models

  • 通过聚类图像嵌入空间识别语义模式,引导生成过程
  • 在多个模型和提示上有效降低偏见,保持图像质量
  • 适合需要公平性保障的图像生成应用

文本到图像(T2I)扩散模型因其生成高分辨率、逼真图像的能力而广泛应用。这些模型通常在大规模数据集(如LAION-5B)上训练,但数据中存在大量偏见,导致模型学习并复现刻板印象。我们提出SelfDebias,一种完全无监督的测试阶段去偏方法,适用于任何以UNet为噪声预测器的扩散模型。SelfDebias在图像编码器的嵌入空间中识别语义聚类,并利用这些聚类指导推理过程中的扩散,最小化输出分布与均匀分布之间的KL散度。与有监督方法不同,SelfDebias无需人工标注数据或为每个概念训练外部分类器,可自动识别语义模式。大量实验表明,SelfDebias在不同提示和模型架构(包括条件与无条件模型)上均具泛化能力,不仅能有效缓解关键人口统计维度的偏见,同时保持生成图像的视觉保真度,还可处理难以识别偏见的抽象概念。

原文摘要 · Abstract (English)

Text-to-image (T2I) diffusion models have achieved widespread success due to their ability to generate high-resolution, photorealistic images. These models are trained on large-scale datasets, like LAION-5B, often scraped from the internet. However, since this data contains numerous biases, the models inherently learn and reproduce them, resulting in stereotypical outputs. We introduce SelfDebias, a fully unsupervised test-time debiasing method applicable to any diffusion model that uses a UNet as its noise predictor. SelfDebias identifies semantic clusters in an image encoder's embedding space and uses these clusters to guide the diffusion process during inference, minimizing the KL divergence between the output distribution and the uniform distribution. Unlike supervised approaches, SelfDebias does not require human-annotated datasets or external classifiers trained for each generated concept. Instead, it is designed to automatically identify semantic modes. Extensive experiments show that SelfDebias generalizes across prompts and diffusion model architectures, including both conditional and unconditional models. It not only effectively debiases images along key demographic dimensions while maintaining the visual fidelity of the generated images, but also more abstract concepts for which identifying biases is also challenging.

去偏扩散模型文本生成图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。