用AI模拟公众讨论,发现角色立场难反映真实民意
From Simulated Citizens to Simulated Deliberation: Challenges in Representation and Interaction

- 基于韩国人口数据构建虚拟角色进行辩论
- 角色立场集中且常与真实人群相反,但辩论中观点变化显著
- 无需互动也能产生立场转变,适合用于生成多元论点
多智能体大模型辩论被视为可扩展的公众讨论模拟方法。为使模拟有效,角色应反映真实人口意见分布,且互动应推动观点演变。本文使用基于人口普查的韩国角色,就真实政策议题展开辩论,并与全国调查数据对比。结果显示,角色未能可靠再现真实人口意见模式:其回答往往过度集中,且常反转人类数据中的群体差异。尽管如此,辩论仍生成了有理据、相互回应且多样化的论点,并出现显著立场变动。然而,这种变动大多不依赖同伴交流——封闭式独白角色在相似速率下改变立场,最终结果几乎与完整辩论一致;初始立场差异大的群体也常收敛至相似终点。若以真实人口数据设定初始立场,则更新被显著抑制。因此,人口代表性、论点生成与互动驱动的观点变化并未同步发生。模拟虽能有效呈现正反方论点,但是否涵盖人类观点多样性仍待验证,凸显其在论点挖掘方面的潜力,同时提示人口模拟仍需进一步验证。
原文摘要 · Abstract (English)
Multi-agent LLM deliberation has been explored as a scalable way to simulate public deliberation. For such simulations to be informative, persona agents should reflect population opinion patterns and interaction should shape their conclusions. We evaluate whether LLM-based deliberation can meet these two conditions using census-grounded Korean personas debating real policy questions benchmarked against national surveys. Persona agents do not reliably reproduce population opinion patterns: responses are often far more concentrated and frequently reverse demographic differences in the human data. Deliberations nonetheless produce reasoned, reciprocal, and varied arguments alongside substantial stance movement. Yet much of this movement does not require peer exchange: sealed-monologue agents change position at similar rates and reach nearly the same final balance as full debates, while groups initialized with very different positions often converge to similar endpoints. Anchoring population-informed starting positions, meanwhile, sharply suppresses updating. Thus, population representation, argument generation, and interaction-driven opinion change do not necessarily go together. The simulations readily surface arguments on both sides, though whether they capture the diversity of human perspectives remains untested, leaving open a promising role for argument surfacing even as population simulation requires further validation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。