arXiv:2511.14153cs.LGcs.CY2025-11被引 2

提出自动识别大模型隐性与显性偏见的框架,提升公平性。

A Comprehensive Study of Implicit and Explicit Biases in Large Language Models

  • 构建双路径检测机制,区分显性与隐性偏见。
  • 微调后模型在隐性偏见测试中性能提升最高达20%。
  • 适合关注AI伦理、模型公平性的研究者与开发者。

大型语言模型(LLMs)从训练数据中继承显性和隐性偏见,可能导致有害刻板印象和错误信息传播。本研究针对生成式AI发展背景,通过StereoSet和CrowSPairs等偏见基准评估BERT与GPT 3.5等模型中的多种偏见。提出自动化偏见识别框架,涵盖性别、种族、职业、宗教等社会偏见。采用双路径方法检测显性和隐性偏见。结果显示,微调模型在性别偏见上仍存不足,但在种族偏见识别与规避方面表现良好。分析表明模型过度依赖关键词。通过词袋分析揭示词汇中存在隐性刻板印象。进一步采用提示工程与偏见基准数据增强策略进行微调,跨数据集测试中模型展现出显著适应能力,隐性偏见基准性能提升最高达20%。

原文摘要 · Abstract (English)

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This study highlights the need to address biases in LLMs amid growing generative AI. We studied bias-specific benchmarks such as StereoSet and CrowSPairs to evaluate the existence of various biases in multiple generative models such as BERT and GPT 3.5. We proposed an automated Bias-Identification Framework to recognize various social biases in LLMs such as gender, race, profession, and religion. We adopted a two-pronged approach to detect explicit and implicit biases in text data. Results indicated fine-tuned models struggle with gender biases but excelled at identifying and avoiding racial biases. Our findings illustrated that despite having some success, LLMs often over-relied on keywords. To illuminate the capability of the analyzed LLMs in detecting implicit biases, we employed Bag-of-Words analysis and unveiled indications of implicit stereotyping within the vocabulary. To bolster the model performance, we applied an enhancement strategy involving fine-tuning models using prompting techniques and data augmentation of the bias benchmarks. The fine-tuned models exhibited promising adaptability during cross-dataset testing and significantly enhanced performance on implicit bias benchmarks, with performance gains of up to 20%.

大模型偏见检测公平性微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。