arXiv:2510.13202cs.CLcs.AI2025-10被引 1

用大模型生成反事实数据,减少AI偏见同时保持准确率

LLM-Guided Synthetic Augmentation (LGSA) for Mitigating Bias in AI Systems

  • 用大模型生成性别转换的语义相似句子,增强少数群体数据
  • 在性别分类任务中,偏见差距降至1.9%,准确率达99.1%
  • 适合关注公平性且需保持标签完整性的模型开发者

AI系统中的偏见问题尤其在依赖自然语言数据时引发伦理与实际挑战。某些群体代表性不足常导致跨人群性能不均。传统公平性方法依赖受保护属性标签,存在准确率-公平性权衡,且难以跨数据集泛化。为此,我们提出大语言模型引导的合成增广(LGSA),利用大模型为少数群体生成反事实样本,同时保持标签完整性。我们在包含性别代词、职业和二分类标签的英文短句控制数据集上评估了LGSA。通过结构化提示生成性别互换的改写句,并进行语义相似度检查、属性验证、毒性筛查和人工抽查以确保质量。增广后数据用于一致条件下训练分类器。结果表明,LGSA在不降低准确率的前提下减轻性能差异:基线模型准确率96.7%,性别偏见差距7.2%;简单替换增广将差距降至0.7%,但准确率降为95.6%;而LGSA实现99.1%准确率,偏见差距1.9%,并提升女性标签样本表现。这些发现证明LGSA是有效的偏见缓解策略,可在保持高任务准确率和标签保真度的同时改善子群平衡。

原文摘要 · Abstract (English)

Bias in AI systems, especially those relying on natural language data, raises ethical and practical concerns. Underrepresentation of certain groups often leads to uneven performance across demographics. Traditional fairness methods, such as pre-processing, in-processing, and post-processing, depend on protected-attribute labels, involve accuracy-fairness trade-offs, and may not generalize across datasets. To address these challenges, we propose LLM-Guided Synthetic Augmentation (LGSA), which uses large language models to generate counterfactual examples for underrepresented groups while preserving label integrity. We evaluated LGSA on a controlled dataset of short English sentences with gendered pronouns, professions, and binary classification labels. Structured prompts were used to produce gender-swapped paraphrases, followed by quality control including semantic similarity checks, attribute verification, toxicity screening, and human spot checks. The augmented dataset expanded training coverage and was used to train a classifier under consistent conditions. Results show that LGSA reduces performance disparities without compromising accuracy. The baseline model achieved 96.7 percent accuracy with a 7.2 percent gender bias gap. Simple swap augmentation reduced the gap to 0.7 percent but lowered accuracy to 95.6 percent. LGSA achieved 99.1 percent accuracy with a 1.9 percent bias gap, improving performance on female-labeled examples. These findings demonstrate that LGSA is an effective strategy for bias mitigation, enhancing subgroup balance while maintaining high task accuracy and label fidelity.

AI公平性偏见缓解合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。