arXiv:2502.03826cs.CV2025-02

用大模型检测文本生成图像中的社会偏见并动态调整属性分布。

FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing

  • 通过潜在变量引导分解生成得分,实现可解释的偏见控制。
  • 大模型自动识别偏见类别与属性,检测能力超越人类平均水平。
  • 用户可实时调整属性分布,兼顾去偏、多样性和图像质量。

文本到图像(T2I)模型虽推动了内容创作发展,但依赖未经筛选的大规模数据集常导致社会偏见再现。本文提出 FairT2I,一种无需训练且可交互的框架,基于数学严谨的潜在变量引导公式。该公式将生成得分函数分解为属性条件分量,并按预设分布重加权,提供统一灵活的偏见感知生成机制,涵盖多种现有去偏方法作为特例。框架包含:(1) 潜在变量引导为核心机制;(2) 利用大语言模型(LLM)从文本提示中自动推断偏见相关类别与属性,嵌入潜在结构;(3) 属性重采样,支持用户根据均匀分布、真实世界统计或自定义分布调整属性权重。配套用户界面支持实时查看检测到的偏见、修改属性或权重,并生成去偏图像。实验表明,LLM在检测偏见类别与属性的数量和粒度上优于平均人类标注者。FairT2I 在缓解社会偏见和保持图像多样性方面优于基线模型,同时维持高质量图像与提示保真度。

原文摘要 · Abstract (English)

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a mathematically principled latent variable guidance formulation. This formulation decomposes the generative score function into attribute-conditioned components and reweights them according to a defined distribution, providing a unified and flexible mechanism for bias-aware generation that also subsumes many existing ad hoc debiasing approaches as special cases. Building upon this foundation, FairT2I incorporates (1) latent variable guidance as the core mechanism, (2) LLM-based bias detection to automatically infer bias-prone categories and attributes from text prompts as part of the latent structure, and (3) attribute resampling, which allows users to adjust or redefine the attribute distribution based on uniform, real-world, or user-specified statistics. The accompanying user interface supports this pipeline by enabling users to inspect detected biases, modify attributes or weights, and generate debiased images in real time. Experimental results show that LLMs outperform average human annotators in the number and granularity of detected bias categories and attributes. Moreover, FairT2I achieves superior performance to baseline models in both societal bias mitigation and image diversity, while preserving image quality and prompt fidelity.

文本生成去偏大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。