用大模型量化总统辩论表现,看候选人如何打动不同人群。
LLM-POTUS Score: A Framework of Analyzing Presidential Debates with Large Language Models
- 基于3P与3I框架,分析候选人的政策、形象和立场与四类观众的匹配度。
- 通过大模型生成可量化的LLM-POTUS评分,揭示不同策略对受众的影响差异。
- 为公众提供独立评估工具,减少媒体偏见,提升民主参与透明度。
大型语言模型在自然语言处理中表现出色,但在政治话语分析中的应用仍不充分。本文提出一种新方法,利用大模型评估总统辩论表现,解决长期存在的客观评价难题。框架聚焦候选人‘政策、形象、视角’(3P)与‘利益、意识形态、身份认同’(3I)在四类关键群体——选民、企业、捐助者、政界人士——中的契合度。通过大模型生成的LLM-POTUS Score,实现对辩论表现的多维量化评估。应用于近年美国总统辩论文本,揭示不同辩论策略对各群体的实际影响。该研究不仅提供新的政治分析工具,也探索大模型作为中立裁判在复杂社会语境中的潜力与局限。同时,为公民提供独立评估手段,降低对有偏媒体和制度影响的依赖,增强知情公民参与基础。
原文摘要 · Abstract (English)
Large language models have demonstrated remarkable capabilities in natural language processing, yet their application to political discourse analysis remains underexplored. This paper introduces a novel approach to evaluating presidential debate performances using LLMs, addressing the longstanding challenge of objectively assessing debate outcomes. We propose a framework that analyzes candidates' "Policies, Persona, and Perspective" (3P) and how they resonate with the "Interests, Ideologies, and Identity" (3I) of four key audience groups: voters, businesses, donors, and politicians. Our method employs large language models to generate the LLM-POTUS Score, a quantitative measure of debate performance based on the alignment between 3P and 3I. We apply this framework to analyze transcripts from recent U.S. presidential debates, demonstrating its ability to provide nuanced, multi-dimensional assessments of candidate performances. Our results reveal insights into the effectiveness of different debating strategies and their impact on various audience segments. This study not only offers a new tool for political analysis but also explores the potential and limitations of using LLMs as impartial judges in complex social contexts. In addition, this framework provides individual citizens with an independent tool to evaluate presidential debate performances, which enhances democratic engagement and reduces reliance on potentially biased media interpretations and institutional influence, thereby strengthening the foundation of informed civic participation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。