arXiv:2601.08785cs.AI2026-01被引 9

用议会投票记录测试大模型政治偏见,发现其普遍左倾且歧视右翼政党。

Uncovering Political Bias in Large Language Models using Parliamentary Voting Records

  • 通过真实议会投票数据构建政治偏见评估基准。
  • 三国数据集显示主流大模型倾向左翼或中间立场。
  • 首次实现模型与政党的意识形态在二维空间可视化对比。

随着大型语言模型(LLMs)深度嵌入数字平台和决策系统,其政治偏见问题日益引发关注。尽管已有大量研究探讨性别、种族等社会偏见,但系统性地分析政治偏见的工作仍有限,而后者对社会影响深远。本文提出一种通用方法,通过将模型生成的投票预测与经验证的议会投票记录对齐,构建政治偏见评估基准。我们在三个国家开展案例研究:PoliBiasNL(2,701条荷兰议会动议与投票,涉及15个政党)、PoliBiasNO(10,584条挪威动议与投票,9个政党)和PoliBiasES(2,480条西班牙动议与投票,10个政党)。在这些基准上,我们评估了模型的意识形态倾向及对政治实体的偏见。同时,我们提出一种方法,将模型与政党的投票立场映射至共享的两维CHES(Chapel Hill Expert Survey)空间,实现模型与现实政治主体间可解释的直接比较。实验揭示出精细的意识形态差异:当前最先进的大模型普遍表现出左倾或中间倾向,并对右翼保守政党存在明显负面偏见。这些发现凸显了基于真实议会行为的透明、跨国评估在理解与审计现代大模型政治偏见方面的价值。

原文摘要 · Abstract (English)

As large language models (LLMs) become deeply embedded in digital platforms and decision-making systems, concerns about their political biases have grown. While substantial work has examined social biases such as gender and race, systematic studies of political bias remain limited, despite their direct societal impact. This paper introduces a general methodology for constructing political bias benchmarks by aligning model-generated voting predictions with verified parliamentary voting records. We instantiate this methodology in three national case studies: PoliBiasNL (2,701 Dutch parliamentary motions and votes from 15 political parties), PoliBiasNO (10,584 motions and votes from 9 Norwegian parties), and PoliBiasES (2,480 motions and votes from 10 Spanish parties). Across these benchmarks, we assess ideological tendencies and political entity bias in LLM behavior. As part of our evaluation framework, we also propose a method to visualize the ideology of LLMs and political parties in a shared two-dimensional CHES (Chapel Hill Expert Survey) space by linking their voting-based positions to the CHES dimensions, enabling direct and interpretable comparisons between models and real-world political actors. Our experiments reveal fine-grained ideological distinctions: state-of-the-art LLMs consistently display left-leaning or centrist tendencies, alongside clear negative biases toward right-conservative parties. These findings highlight the value of transparent, cross-national evaluation grounded in real parliamentary behavior for understanding and auditing political bias in modern LLMs.

政治偏见大模型评测议会数据意识形态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。