arXiv:2505.04171cs.CYcs.CL2025-05被引 12

大模型看似中立,实则能通过对话引导用户政治立场,影响可达10个百分点。

The Political Ideology of Large Language Models: Measurement, Inconsistency, and Persuasive Influence

  • 用43个模型对比立法者与选民,发现其立场是多议题偏见的抵消结果。
  • 实验显示模型可使用户立场平均偏移3.5个百分点,强引导下超10个百分点。
  • 即使不熟悉模型的人也易受影响,适合关注信息生态与舆论操控的研究者。

大型语言模型(LLMs)正深刻改变人们获取信息与互动方式。尽管学术研究普遍认为其政治偏见较小,我们提出质疑。首先,将43个LLM与议员、法官及美国代表性选民样本对比,发现其看似中立的整体立场,实为特定议题上强烈偏见的相互抵消,类似温和选民。其次,在一项预注册随机实验中,让选民与模型讨论政策议题,结果显示用户立场平均向模型方向偏移3.5个百分点,效果至少相当于专业竞选广告。若明确引导模型支持某一立场,态度偏移超过10个百分点,且该引导解释了整体效应。在自然对话中无显著影响,置信区间排除了微小效应的可能性。出乎意料的是,该影响不受模型熟悉度、新闻消费或政治兴趣调节。这表明,尤其由私营企业或政府控制的模型,可能成为强大且精准的政治影响力工具。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are a transformational technology, fundamentally changing how people obtain information and interact with the world. As people become increasingly reliant on them for an enormous variety of tasks, a body of academic research has developed to examine these models for inherent biases, especially political biases, often finding them small. We challenge this prevailing wisdom. First, by comparing 43 LLMs to legislators, judges, and a nationally representative sample of U.S. voters, we show that LLMs' apparently moderate overall partisan positioning is the net result of offsetting strongly partisan expressed positions on specific topics, much like moderate voters. Second, in a pre-registered randomized experiment, we show that LLMs can exert persuasive influence on political attitudes. Voters randomized to discuss a policy issue with an LLM shift toward that model's measured ideological position by 3.5 percentage points on average, an effect at least as large as those produced by professional campaign advertising. Explicitly prompting a model to argue one side of the issue shifts attitudes by more than 10 percentage points relative to unsteered conversations, and this steering accounts for the pooled effect. When the same models converse naturally, without steering, we detect no persuasive effect, and our confidence interval rules out effects as small as the pre-registered smallest effect of interest. Contrary to expectations, these persuasive effects are not moderated by familiarity with LLMs, news consumption, or interest in politics. LLMs, especially those controlled by private companies or governments, may become a powerful and targeted vector for political influence.

大模型政治偏见说服力意识形态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。