arXiv:2606.26489cs.CL2026-06

比较两种方法在德语气候新闻中识别威胁与解决方案框架的效果

Comparing BERT Sentence-Pair Classification and Few-Shot LLM Prompting for Detecting Threat and Solution Framing in German Climate News

  • 用上下文句子增强的BERT模型做句对分类,提升识别准确率
  • 微调BERT模型F1达0.83,优于提示大模型的0.78
  • 适合研究媒体话语、社会科学研究者使用

新闻媒体在塑造公众对气候变化的认知中起关键作用,报道中强调威胁或解决方案会显著影响受众参与度和政策支持。在句子层面自动检测这些话语框架,可使研究者分析无法人工标注的大规模语料。本文系统比较了两种方法:一是使用开权重大语言模型(Llama 4 Maverick)进行少样本提示,结合思维链推理与置信度评分;二是微调德国版BERT模型(deepset/gbert-large)进行句对分类,以前提句子为上下文。两种方法均设置独立的威胁与解决方案二分类器。在440篇奥地利报纸文章组成的语料库上评估,手动标注依据专家制定的编码方案。微调后的BERT模型在威胁与解决方案任务上均取得0.83的F1分数,而基于LLM的方法达到0.78。消融实验表明,提供前一句作为上下文能显著提升BERT性能,优于单句输入。结果为计算社会科学中微调编码器模型与提示生成模型在文本分类中的比较提供了新证据。

原文摘要 · Abstract (English)

News media play a central role in shaping public perceptions of climate change, and whether coverage emphasizes threats or solutions has measurable effects on audience engagement and policy support. Automated detection of these framing patterns at the sentence level would allow researchers to analyze large corpora that are infeasible to code manually. We present a systematic comparison of two approaches for classifying sentences from German-language climate news articles as threat-oriented, solution-oriented, both, or neither. The first approach uses few-shot prompting with an open-weights large language model (Llama 4 Maverick), employing chain-of-thought reasoning and structured output with confidence scoring. The second approach fine-tunes a German BERT model (deepset/gbert-large) for sentence-pair classification, where the preceding sentence provides contextual information for the target sentence. Both approaches implement two independent binary classifiers, one for threat framing and one for solution framing. We evaluate both methods on a corpus of 440 Austrian newspaper articles that were manually coded following a detailed coding scheme developed with domain experts. The fine-tuned BERT classifiers achieve an F1 score of 0.83 for both the threat and solution tasks, while the LLM-based classifiers reach an F1 of 0.78. An ablation study confirms that providing the preceding sentence as context improves BERT classification performance substantially compared to single-sentence input. These results contribute to the growing body of work comparing fine-tuned encoder models with prompted generative models for text classification in computational social science.

文本分类媒体分析BERT大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。