arXiv:2604.18167cs.CV2026-04

无需微调,通过嵌入空间运算实现文本生成图像的偏见缓解。

Embedding Arithmetic: A Lightweight, Tuning-Free Framework for Post-hoc Bias Mitigation in Text-to-Image Models

论文配图:Embedding Arithmetic: A Lightweight, Tuning-Free Framework for Post-hoc Bias Mitigation in Text-to-Image Models
图 1 · 摘自论文原文
  • 在推理阶段利用嵌入算术修正偏见,不改模型权重或提示词。
  • 在FLUX 1.0-Dev和SD 3.5-Large上显著提升多样性,同时保持语义一致性。
  • 提出新评估指标CCS,解决现有方法的循环性与偏见问题,适合伦理敏感场景应用。

现代文本到图像(T2I)模型会放大有害的社会偏见,阻碍其伦理部署。本文提出一种推理时的无微调方法,可有效缓解社会偏见,同时保持提示语义及视觉上下文(背景、布局、风格)不变,确保上下文持续性,并提供可调节参数以控制缓解强度,使从业者能精细调控公平性与一致性之间的权衡。基于嵌入算术,我们分析了偏见在嵌入空间中的结构,并在不修改模型权重、提示词或数据集的情况下进行纠正。实验发现,条件嵌入空间构成复杂且纠缠的流形,而非解耦的概念网格。为克服CLIP评分在循环性和偏见上的局限,我们提出概念一致性评分(CCS)。在该鲁棒指标下,本方法显著优于现有基线,在提升多样性的同时维持高概念一致性,有效解决关键的公平性-一致性权衡问题。通过刻画模型对社会概念的表示方式,我们建立了潜在空间几何理解,为更透明、可控、公平的图像生成提供了原则性路径。

原文摘要 · Abstract (English)

Modern text-to-image (T2I) models amplify harmful societal biases, challenging their ethical deployment. We introduce an inference-time method that reliably mitigates social bias while keeping prompt semantics and visual context (background, layout, and style) intact. This ensures context persistency and provides a controllable parameter to adjust mitigation strength, giving practitioners fine-grained control over fairness-coherence trade-offs. Using Embedding Arithmetic, we analyze how bias is structured in the embedding space and correct it without altering model weights, prompts, or datasets. Experiments on FLUX 1.0-Dev and Stable Diffusion 3.5-Large show that the conditional embedding space forms a complex, entangled manifold rather than a grid of disentangled concepts. To rigorously assess semantic preservation beyond the circularity and bias limitations of of CLIP scores, we propose the Concept Coherence Score (CCS). Evaluated against this robust metric, our lightweight, tuning-free method significantly outperforms existing baselines in improving diversity while maintaining high concept coherence, effectively resolving the critical fairness-coherence trade-off. By characterizing how models represent social concepts, we establish geometric understanding of latent space as a principled path toward more transparent, controllable, and fair image generation.

偏见缓解嵌入空间文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。