arXiv:2510.08236cs.LGcs.AI2025-10被引 2

研究大模型政治偏见,发现普遍左倾且隐性偏见更明显

The Hidden Bias: A Study on Explicit and Implicit Political Stereotypes in Large Language Models

  • 用政治光谱测试法评估8个大模型的立场倾向
  • 所有模型均呈左倾,语言变体下隐性偏见更显著
  • 隐性与显性偏见高度一致,反映模型对自身偏见的感知

大型语言模型(LLMs)在信息传播和决策中日益重要。鉴于其广泛的社会影响,理解其潜在偏见,尤其是政治领域偏见,对防止公众舆论和民主进程被不当影响至关重要。本研究通过二维政治光谱测试(PCT)分析8个主流大模型的政治偏见与刻板印象传播。首先,使用PCT评估模型的固有政治倾向;其次,通过角色提示(persona prompting)PCT探测不同社会维度下的显性刻板印象;最后,利用多语言版本PCT评估隐性刻板印象。关键发现:所有模型均呈现持续的左倾倾向;尽管各模型刻板印象的性质与程度差异显著,但通过语言变异诱发的隐性刻板印象强于显性提示下的结果;多数模型的隐性和显性刻板印象表现出显著一致性,暗示模型对其内在偏见具有一定程度的‘认知’或透明度。该研究揭示了大模型中政治偏见与刻板印象的复杂互动。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly integral to information dissemination and decision-making processes. Given their growing societal influence, understanding potential biases, particularly within the political domain, is crucial to prevent undue influence on public opinion and democratic processes. This work investigates political bias and stereotype propagation across eight prominent LLMs using the two-dimensional Political Compass Test (PCT). Initially, the PCT is employed to assess the inherent political leanings of these models. Subsequently, persona prompting with the PCT is used to explore explicit stereotypes across various social dimensions. In a final step, implicit stereotypes are uncovered by evaluating models with multilingual versions of the PCT. Key findings reveal a consistent left-leaning political alignment across all investigated models. Furthermore, while the nature and extent of stereotypes vary considerably between models, implicit stereotypes elicited through language variation are more pronounced than those identified via explicit persona prompting. Interestingly, for most models, implicit and explicit stereotypes show a notable alignment, suggesting a degree of transparency or "awareness" regarding their inherent biases. This study underscores the complex interplay of political bias and stereotypes in LLMs.

大模型偏见政治刻板印象隐性偏见语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。