arXiv:2505.04393cs.CL2025-05被引 13

大模型越庞大,越倾向左翼政治立场,可能影响公众判断。

Large Means Left: Political Bias in Large Language Models Increases with Their Number of Parameters

  • 用德国议会投票匹配度衡量模型政治倾向
  • 参数越多的模型左倾倾向越明显,最大偏差达18.7%
  • 提示词风格和模型发布时间也显著影响其立场

随着人工智能普及,需评估其内在偏见以减轻对用户的影响。大型语言模型(LLMs)常作为信息主要来源,却频繁出现事实错误、虚构内容(幻觉)或偏见,导致用户接触误导性信息并影响观点。本文以德国联邦议院最新投票为背景,采用Wahl-O-Mat评分衡量模型政治立场一致性。结果显示,模型倾向左翼政党,尤其在参数量更大的模型中表现更明显,最大偏差达18.7%。此外,提示语风格与模型发布日期也显著影响其政治倾向。研究表明,大型企业有责任管控此类偏见,因其可能大规模影响选民决策与公共舆论。

原文摘要 · Abstract (English)

With the increasing prevalence of artificial intelligence, careful evaluation of inherent biases needs to be conducted to form the basis for alleviating the effects these predispositions can have on users. Large language models (LLMs) are predominantly used by many as a primary source of information for various topics. LLMs frequently make factual errors, fabricate data (hallucinations), or present biases, exposing users to misinformation and influencing opinions. Educating users on their risks is key to responsible use, as bias, unlike hallucinations, cannot be caught through data verification. We quantify the political bias of popular LLMs in the context of the recent vote of the German Bundestag using the score produced by the Wahl-O-Mat. This metric measures the alignment between an individual's political views and the positions of German political parties. We compare the models' alignment scores to identify factors influencing their political preferences. Doing so, we discover a bias toward left-leaning parties, most dominant in larger LLMs. Also, we find that the language we use to communicate with the models affects their political views. Additionally, we analyze the influence of a model's origin and release date and compare the results to the outcome of the recent vote of the Bundestag. Our results imply that LLMs are prone to exhibiting political bias. Large corporations with the necessary means to develop LLMs, thus, knowingly or unknowingly, have a responsibility to contain these biases, as they can influence each voter's decision-making process and inform public opinion in general and at scale.

大模型政治偏见语言模型德国选举

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。