首个系统框架,指导大模型在政治科学中的应用与研究。
Political-LLM: Large Language Models in Political Science
- 构建政治科学与计算方法双视角分类体系,厘清研究脉络。
- 提出适配政治场景的数据、微调与评估新方法。
- 聚焦公平性、领域数据与人机协作,指引未来方向。
近年来,大语言模型(LLMs)被广泛应用于选举预测、情感分析、政策影响评估和虚假信息检测等政治科学任务。与此同时,系统理解大模型如何进一步推动该领域发展的需求日益迫切。本文由计算机科学与政治科学跨学科团队提出首个系统性框架——Political-LLM,以推进大模型在计算政治科学中的综合理解。我们首先建立一个基础分类体系,将现有研究划分为政治科学与计算方法两个视角:从政治科学视角出发,强调大模型在自动化预测与生成任务、行为动态模拟以及通过反事实生成改进因果推断中的作用;从计算视角出发,介绍面向政治语境的模型数据准备、微调与评估方法的进展。文中识别关键挑战与未来方向,强调构建领域专用数据集、解决偏见与公平问题、融合人类专业知识,并重新定义评估标准以契合计算政治科学的独特需求。Political-LLM旨在成为研究人员使用人工智能开展知情、伦理且具影响力的学术研究的指南。在线资源详见:http://political-llm.org/。
原文摘要 · Abstract (English)
In recent years, large language models (LLMs) have been widely adopted in political science tasks such as election prediction, sentiment analysis, policy impact assessment, and misinformation detection. Meanwhile, the need to systematically understand how LLMs can further revolutionize the field also becomes urgent. In this work, we--a multidisciplinary team of researchers spanning computer science and political science--present the first principled framework termed Political-LLM to advance the comprehensive understanding of integrating LLMs into computational political science. Specifically, we first introduce a fundamental taxonomy classifying the existing explorations into two perspectives: political science and computational methodologies. In particular, from the political science perspective, we highlight the role of LLMs in automating predictive and generative tasks, simulating behavior dynamics, and improving causal inference through tools like counterfactual generation; from a computational perspective, we introduce advancements in data preparation, fine-tuning, and evaluation methods for LLMs that are tailored to political contexts. We identify key challenges and future directions, emphasizing the development of domain-specific datasets, addressing issues of bias and fairness, incorporating human expertise, and redefining evaluation criteria to align with the unique requirements of computational political science. Political-LLM seeks to serve as a guidebook for researchers to foster an informed, ethical, and impactful use of Artificial Intelligence in political science. Our online resource is available at: http://political-llm.org/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。