不靠角色扮演,用真实话题测试大模型政治倾向
Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Models
- 不用虚拟人设,用真实民意调查题测模型立场
- 43个模型多呈中左倾向,但互动模式差异大
- 模型规模和开源与否不影响立场,机构背景更重要
随着大语言模型(LLMs)日益嵌入公民、教育和政治信息环境,其潜在政治偏见引发关注。以往研究常通过模拟人格或预设意识形态类型评估偏见,可能引入人为框架效应,忽略实际使用场景。本研究采用无角色、话题特定的方法评估模型政治行为,反映用户典型交互方式。提出二维框架:一维衡量在高极化议题(如堕胎、移民)上的党派倾向,另一维评估在低极化议题(如气候变化、外交政策)上的社会政治参与度。基于来自美国、欧洲、中国和中东的43个大模型,使用源自美国国家选举研究(ANES)和皮尤研究中心的问卷式提示进行分析。提出熵加权偏见评分以量化党派对齐的方向与一致性,并通过参与度画像识别出四类行为集群。结果表明,多数模型呈中左或左翼意识形态,非党派参与模式差异显著。模型规模和开放性并非行为强预测因子,表明对齐策略与制度背景在塑造政治表达中起决定性作用。
原文摘要 · Abstract (English)
As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown. Prior research often evaluates such bias through simulated personas or predefined ideological typologies, which may introduce artificial framing effects or overlook how models behave in general use scenarios. This study adopts a persona-free, topic-specific approach to evaluate political behavior in LLMs, reflecting how users typically interact with these systems-without ideological role-play or conditioning. We introduce a two-dimensional framework: one axis captures partisan orientation on highly polarized topics (e.g., abortion, immigration), and the other assesses sociopolitical engagement on less polarized issues (e.g., climate change, foreign policy). Using survey-style prompts drawn from the ANES and Pew Research Center, we analyze responses from 43 LLMs developed in the U.S., Europe, China, and the Middle East. We propose an entropy-weighted bias score to quantify both the direction and consistency of partisan alignment, and identify four behavioral clusters through engagement profiles. Findings show most models lean center-left or left ideologically and vary in their nonpartisan engagement patterns. Model scale and openness are not strong predictors of behavior, suggesting that alignment strategy and institutional context play a more decisive role in shaping political expression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。