arXiv:2410.24190cs.CLcs.CY2024-10EMNLP被引 103

LLMs暗中偏袒民主党,影响选民投票倾向

Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voters

  • 测试18个大模型在总统选举中的政治倾向
  • 与LLM对话后民主候选人得票率提升4.6个百分点
  • 适合关注AI对民主影响的研究者和政策制定者

LLM如何影响民主?我们通过多项实验,在美国总统选举背景下研究了大模型的政治倾向及其对选民的影响。在投票模拟中,我们发现18个开源与闭源大模型均表现出对民主党候选人的偏好。指令微调模型相比基础版本,对候选人政策相关问题的回答更偏向民主党。进一步实验涉及935名美国注册选民,参与者与Claude-3、Llama-3和GPT-4进行五轮交互。结果显示,与大模型对话后,选民支持民主党候选人的比例从0.7%上升至4.6%,即使大模型未主动劝说。该影响程度超过以往多数政治竞选研究。许多用户表示希望继续与大模型进行政治交流。驱动这一转变的具体交互因素仍需深入研究。最后,我们探讨了安全方法如何使大模型更中立,但也引发对真正中立是否可取的疑问。

原文摘要 · Abstract (English)

How could LLMs influence our democracy? We investigate LLMs' political leanings and the potential influence of LLMs on voters by conducting multiple experiments in a U.S. presidential election context. Through a voting simulation, we first demonstrate 18 open- and closed-weight LLMs' political preference for a Democratic nominee over a Republican nominee. We show how this leaning towards the Democratic nominee becomes more pronounced in instruction-tuned models compared to their base versions by analyzing their responses to candidate-policy related questions. We further explore the potential impact of LLMs on voter choice by conducting an experiment with 935 U.S. registered voters. During the experiments, participants interacted with LLMs (Claude-3, Llama-3, and GPT-4) over five exchanges. The experiment results show a shift in voter choices towards the Democratic nominee following LLM interaction, widening the voting margin from 0.7% to 4.6%, even though LLMs were not asked to persuade users to support the Democratic nominee during the discourse. This effect is larger than many previous studies on the persuasiveness of political campaigns, which have shown minimal effects in presidential elections. Many users also expressed a desire for further political interaction with LLMs. Which aspects of LLM interactions drove these shifts in voter choice requires further study. Lastly, we explore how a safety method can make LLMs more politically neutral, while raising the question of whether such neutrality is truly the path forward.

大模型政治倾向选民影响民主

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。