arXiv:2509.07274cs.CLcs.CY2025-09

用大模型分析德国150年议会辩论,发现近十年反移民情绪显著上升。

LLM Analysis of 150+ years of German Parliamentary Debates on Migration Reveals Shift from Post-War Solidarity to Anti-Solidarity in the Last Decade

  • 基于理论框架设计标注方案,用大模型自动识别政治话语中的团结与对立
  • 2015年后反团结言论激增,战后初期以群体关怀和共情为主
  • 结合软标签与统计校正,提升长期趋势分析的可靠性

移民是德国政治讨论的核心议题,涵盖战后难民安置、劳动力迁移及近年难民潮。传统大规模话语分析依赖人工标注,覆盖有限。大语言模型(LLMs)提供可扩展替代方案。本文采用理论驱动的标注体系,评估多个LLMs在识别德语议会辩论中团结与反团结子类型上的表现,并检验其标签是否支持有效下游推断。我们系统评估了模型规模、提示策略、微调、历史与当代数据、系统性误差等影响因素。最强模型(如GPT-5和gpt-oss-120B)的宏观F1得分接近人类一致性,但系统性误差可能扭曲长期趋势。因此,我们结合软标签输出与设计型监督学习(DSL),以减少长期趋势估计偏差。除方法评估外,我们从社会科学视角分析帝国议会(1867–1933)、西德联邦议院(1949–1990)与统一后联邦议院(1990–2025)语料库,追踪对移民的团结与反团结趋势,重点考察战后德国(1949–1957)与当代德国(2009–2025)。结果显示战后时期团结水平较高,尤以群体性和共情形式为特征;自2015年起反团结情绪显著上升。研究认为,LLMs可助力大规模社会科学研究,但其输出需严格验证,存在系统性偏差时须进行统计修正。

原文摘要 · Abstract (English)

Migration has been a core topic in German political debate, from postwar expellee displacement to labor migration and recent refugee movements. Large-scale analysis of such political discourse has traditionally required extensive manual annotation, limiting coverage. Large language models (LLMs) offer a scalable alternative. Using a theory-driven annotation scheme, we examine how well LLMs annotate subtypes of solidarity and anti-solidarity in German parliamentary debates and whether the resulting labels support valid downstream inference. We first evaluate multiple LLMs across model size, prompting strategies, fine-tuning, historical versus contemporary data, and systematic errors. The strongest models, especially GPT-5 and gpt-oss-120B, achieve macro- F1 scores comparable to human agreement, although their systematic errors can bias downstream results. We therefore combine soft-label model outputs with Design-based Supervised Learning (DSL) to reduce bias in long-term trend estimates. Beyond the methodological evaluation, we interpret the resulting annotations from a social-scientific perspective across the Reichstag (1867- 1933), West German Bundestag (1949-1990) and Re-Unified German Bundestag (1990-2025) corpus to trace trends in solidarity and anti-solidarity toward migrants, with detailed analysis of postwar Germany (1949-1957) and contemporary Germany (2009-2025). We find relatively high levels of solidarity in the postwar period, especially in group-based and compassionate forms, and a marked rise in anti-solidarity since 2015. We argue that LLMs can support large-scale social-scientific text analysis, but their outputs require rigorous validation and, where systematic errors are present, statistical correction.

大模型政治话语移民政策文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。