arXiv:2605.28036cs.CVcs.LG2026-05

让扩散模型在不同引导强度下都保持公平,解决调参导致的偏见问题。

Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales

论文配图:Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales
图 1 · 摘自论文原文
  • 分解偏见为模型偏见和引导偏见,发现引导偏见随强度上升而主导
  • 提出StayFair算法,在分类器与无分类器引导中分别均衡输出分布
  • 可无缝叠加到现有公平模型上,不牺牲图像质量且适配多场景

扩散模型通过可调引导强度权衡提示对齐与多样性,但现有去偏方法仅针对单一强度,用户调整参数时公平性下降。我们首次将总偏见拆分为模型偏见与引导偏见,发现引导偏见随引导强度单调增长,最终主导高引导场景。为此,我们将强群体平等扩展至引导机制,推导出目标分布跨引导尺度保持群体比例的条件。提出StayFair:在分类器引导中均衡各组分类器输出分布,在无分类器引导中引入依赖提示的空嵌入偏移。因仅修改引导步骤,该方法与模型去偏正交,可叠加于已有公平扩散模型,实现跨引导尺度的公平生成。在类别条件与文本到图像生成任务中,StayFair解耦了公平性与引导强度,未牺牲图像质量。

原文摘要 · Abstract (English)

Diffusion models steer conditional generation with a tunable guidance scale to trade off prompt alignment and diversity. However, existing debiasing techniques are optimized for a single scale, degrading fairness when users adjust this parameter. We trace this behavior to a previously overlooked source by decomposing total bias into two components: a model bias and a guidance bias. While prior work primarily targets the former, we show that the guidance bias grows monotonically with the guidance scale, eventually dominating the high-guidance regimes users prefer. To address this, we extend Strong Demographic Parity to guidance and derive a condition under which the target distribution retains its group ratio across guidance scales. We propose StayFair, which leverages this condition to design fair guidance algorithms in both regimes. For classifier guidance, it equalizes the classifier's output distributions across groups; for classifier-free guidance, it shifts the null embedding by a prompt-dependent offset. Because StayFair modifies only the guidance step, it is orthogonal to model debiasing and can be layered onto existing fair diffusion models to extend their fairness across guidance scales. Across class-conditional and text-to-image generation, StayFair decouples fairness from the guidance scale without sacrificing image quality.

扩散模型公平性引导机制去偏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。