让大模型通过推理更准确表达政治立场,提升政策模拟可信度。
Reasoning Boosts Opinion Alignment in LLMs
- 用结构化推理训练模型保持观点一致性
- 在美、欧、瑞士三组数据上提升立场建模效果
- 适合研究数字民主与政治数字孪生的学者
意见建模旨在捕捉个人或群体的政治偏好,服务于数字民主等应用,使模型能辅助制定更公平、更受支持的政策。鉴于大语言模型(LLMs)的多功能性、强泛化能力及其在多种文本到文本任务中的成功表现,它们是该任务的天然候选者。然而,由于其统计本质和有限的因果理解能力,直接提示时容易产生偏见。本文研究推理是否能提升意见对齐。受强化学习推动的数学推理进展启发,我们训练模型通过结构化推理生成与个体档案一致的答案。在涵盖美国、欧洲和瑞士政治的三个数据集上评估表明,推理显著提升了意见建模性能,且媲美强基线,但未能完全消除偏见,凸显了构建忠实政治数字孪生仍需额外机制。我们开源方法与数据集,为未来研究建立坚实基准。
原文摘要 · Abstract (English)
Opinion modeling aims to capture individual or group political preferences, enabling applications such as digital democracies, where models could help shape fairer and more popular policies. Given their versatility, strong generalization capabilities, and demonstrated success across diverse text-to-text applications, large language models (LLMs) are natural candidates for this task. However, due to their statistical nature and limited causal understanding, they tend to produce biased opinions when prompted naively. In this work, we study whether reasoning can improve opinion alignment. Motivated by the recent advancement in mathematical reasoning enabled by reinforcement learning (RL), we train models to produce profile-consistent answers through structured reasoning. We evaluate our approach on three datasets covering U.S., European, and Swiss politics. Results indicate that reasoning enhances opinion modeling and is competitive with strong baselines, but does not fully remove bias, highlighting the need for additional mechanisms to build faithful political digital twins using LLMs. By releasing both our method and datasets, we establish a solid baseline to support future research on LLM opinion alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。