用知识图谱优化提示词,让文生图更公平,减少性别种族偏见。
KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generation

- 基于知识图谱和大模型动态改写提示词,闭环优化公平性
- 在8个主流生成模型上显著降低性别、种族、年龄等偏差
- 无需重训练,适合集成到现有闭源产品中
文生图系统已广泛应用于新闻、教育、广告与公共传播,但其训练数据中的性别、种族、年龄及文化刻板印象会放大为大规模社会危害。现有方法或需昂贵重训练(不适用于闭源模型),或依赖固定模板而忽略文化语境。本文提出KG-FairDiff,一种模型无关、推理时的公平提示优化框架,将公平性引导的提示改写建模为约束优化问题,并实现为闭环流程:约1200条文化与偏见相关三元组的知识图谱提供结构化上下文,大模型生成改写建议,验证器仅接受降低基于分歧的公平损失且保留原始语义的提示。证明了优化循环的有限终止性,构建了数学一致的评估体系,关联偏差指标与目标分布偏离度,审计了八个主流生成模型。结果表明,该方法在保持提示语义的同时,显著缓解了性别、种族、年龄及交叉性差异,提供了一条可落地的公平生成路径。
原文摘要 · Abstract (English)
Text-to-Image (TTI) systems are now everyday infrastructure for journalism, education, advertising, and public communication, and the demographic and cultural stereotypes they inherit from training data (rendering women, people of colour, older adults, and non-Western cultures as under-represented or caricatured) become a population-level harm at deployment scale. Existing mitigations either require costly retraining, infeasible for the closed-source backbones that dominate consumer products, or rely on fixed demographic templates that ignore cultural context. We present KG-FairDiff, a model-agnostic, inference-time framework that formalises fairness-aware prompt refinement as a constrained optimisation problem and operationalises it as a closed-loop pipeline: a knowledge graph of ~1,200 culture- and bias-related triples retrieves structured context, an LLM rewriter proposes refinements, and a validator accepts only prompts that reduce a divergence-based fairness loss while preserving semantic fidelity to the user's original intent. We prove a finite-termination bound for the refinement loop, contribute a mathematically consistent evaluation suite linking Bias-P/Bias-W to divergence from target distributions and ENS to KL divergence, and audit eight widely-deployed backbone generators. KG-FairDiff substantially reduces gender, race, age, and intersectional disparities while preserving prompt semantics, offering a practical, deployment-ready route to more equitable generative AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。