arXiv:2502.15361cs.CLcs.AI2025-02EMNLP被引 27

首次系统评估大模型推理中的社会偏见,发现推理过程会放大性别种族刻板印象。

Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoning

  • 用BBQ数据集分析推理模型的偏见,关注每一步推理语言
  • 发现有偏见的推理步骤常导致错误预测和刻板印象表达
  • 提出轻量级方法ADBP,通过预测变化检测偏见,效果优于基线

大型语言模型(LLM)生成链式思维(CoT)推理已显著提升数学与代码任务表现。然而,当推理过程反映性别、种族或年龄等社会刻板印象时,可能强化有害关联并导致误导性结论。本文首次对原生生成推理链的模型(如DeepSeek-R1、OpenAI o1)进行系统性社会偏见评估,基于BBQ数据集,分析多类模型(包括DeepSeek-R1 8B/32B指令微调及CoT增强版本、ChatGPT等)在预测准确率与推理偏见上的表现。结果表明,有偏见的推理步骤常与错误预测相关,并频繁表达刻板印象。为此,提出答案分布作为偏见代理(ADBP),通过追踪增量推理步骤中模型预测的变化来检测偏见。ADBP在多数情况下优于基线方法SfRP,有效缓解偏见并提升输出准确性。代码已开源:https://github.com/elviswxy/LLM_reasoning_bias。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have enabled automatic generation of chain-of-thought (CoT) reasoning, leading to strong performance on tasks such as math and code. However, when reasoning steps reflect social stereotypes (e.g., those related to gender, race or age), they can reinforce harmful associations and lead to misleading conclusions. We present the first systematic evaluation of social bias within LLM-generated reasoning, focusing on reasoning language models (e.g., DeepSeek-R1, OpenAI o1) that natively produce reasoning chains as part of their answers. Using the BBQ dataset, we analyze both prediction accuracy and reasoning bias across a broad spectrum of models, including instruction-tuned and CoT-augmented variants of DeepSeek-R1 (8B/32B), ChatGPT, and other open-source LLMs. We quantify how biased reasoning steps correlate with incorrect predictions and often lead to stereotype expression. To mitigate reasoning-induced bias, we propose Answer Distribution as Bias Proxy (ADBP), a lightweight mitigation method that detects bias by tracking how model predictions change across incremental reasoning steps. ADBP outperforms Stereotype-free Reasoning Pattern (SfRP) baseline in most cases, mitigating bias and improving the accuracy of LLM outputs. Evaluation and mitigation code is available at https://github.com/elviswxy/LLM_reasoning_bias.

大模型偏见链式推理社会偏见

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。