提出可扩展的文本数据偏见检测与缓解流水线,有效降低性别、宗教等敏感属性的偏见。
Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation
- 用LLM生成高质量词表识别群体标签,定位偏见源
- 通过代表性评分量化偏见,结合语境增强数据增广补偿偏差
- 实测证明能降低文本数据中的显性刻板印象和分布偏差
用于训练大语言模型的文本数据存在多维度偏见,包括有害语言和人口分布失衡。欧盟《人工智能法案》要求识别并缓解数据中对受保护群体的偏见,以防止模型输出不公。然而实际操作指南仍缺乏。本文提出一个包含四个模块的综合偏见检测与缓解流水线,针对可配置的敏感属性,处理表征偏差和(显性)刻板印象两类问题。首先,基于质量标准生成的LLM词表用于识别相关群体标签;其次,采用人口代表性评分量化表征偏差;第三,借助社会语言学知识进行过滤,检测并缓解刻板印象;最后,通过语法与上下文感知的反事实数据增强补偿表征偏差。在性别、宗教和年龄三个属性上进行双层评估:第一,通过人工验证和基线对比,验证各组件在数据去偏上的有效性,结果表明成功降低了数据集中的表征偏差和显性刻板印象;第二,对多个0.6B至8B参数量级的模型在去偏数据集上微调后进行偏见基准测试,结果显示模型在偏见基准上表现未一致提升,暴露出当前评估方法的关键缺陷,凸显需针对性数据操作以应对已显现的模型偏见。
原文摘要 · Abstract (English)
Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating biases against protected groups in data, with the ultimate goal of preventing unfair model outputs. However, practical guidance and operationalization are lacking. We propose a comprehensive data bias detection and mitigation pipeline comprising four components that address two data bias types, namely representation bias and (explicit) stereotypes for a configurable sensitive attribute. First, we leverage LLM-generated word lists created based on quality criteria to detect relevant group labels. Second, representation bias is quantified using the Demographic Representation Score. Third, we detect and mitigate stereotypes using sociolinguistically informed filtering. Finally, we compensate representation bias through Grammar- and Context-Aware Counterfactual Data Augmentation. We conduct a two-fold evaluation using the examples of gender, religion and age. First, the effectiveness of each individual component on data debiasing is evaluated through human validation and baseline comparison. The findings demonstrate that we successfully reduce representation bias and (explicit) stereotypes in a text dataset. Second, the effect of data debiasing on model bias reduction is evaluated by bias benchmarking of several models (0.6B-8B parameters), fine-tuned on the debiased text dataset. This evaluation reveals that LLMs fine-tuned on debiased data do not consistently show improved performance on bias benchmarks, exposing critical gaps in current evaluation methodologies and highlighting the need for targeted data manipulation to address manifested model bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。