首个气候议题网络迷因数据集,揭示立场与媒体框架的关联。
What Media Frames Reveal About Stance: A Dataset and Study about Memes in Climate Change Discourse
- 构建首个标注立场与框架的气候迷因数据集
- 视觉语言模型擅长判断立场但难识别复杂框架
- 适合研究社交媒体舆论与传播机制的学者
媒体框架指对现实特定方面的强调,以塑造公众对议题的理解。其主要目的是在作者观点和立场下影响公众认知,但立场与媒体框架之间的互动仍缺乏研究。本文采用跨学科方法,结合互联网迷因探讨气候变迁议题中的这一互动关系。我们构建了CLIMATEMEMES,这是首个标注立场与媒体框架的气候变迁迷因数据集,灵感来自传播学研究。该数据集包含1,184个来自47个子版块的迷因,支持对不同社区和时间框架主导性的分析,揭示了不同立场群体的框架偏好。我们提出两个任务:立场检测与媒体框架检测。评估了LLaVA-NeXT与Molmo在多种设置下的表现,报告其大语言模型主干的结果。人工标注显著提升性能,合成标注与人工校正的OCR也偶尔有效。研究发现,视觉语言模型在立场识别上表现良好,但在框架识别上逊于大语言模型。最后分析了视觉语言模型在处理气候迷因中细微框架与立场表达时的局限性。
原文摘要 · Abstract (English)
Media framing refers to the emphasis on specific aspects of perceived reality to shape how an issue is defined and understood. Its primary purpose is to shape public perceptions often in alignment with the authors' opinions and stances. However, the interaction between stance and media frame remains largely unexplored. In this work, we apply an interdisciplinary approach to conceptualize and computationally explore this interaction with internet memes on climate change. We curate CLIMATEMEMES, the first dataset of climate-change memes annotated with both stance and media frames, inspired by research in communication science. CLIMATEMEMES includes 1,184 memes sourced from 47 subreddits, enabling analysis of frame prominence over time and communities, and sheds light on the framing preferences of different stance holders. We propose two meme understanding tasks: stance detection and media frame detection. We evaluate LLaVA-NeXT and Molmo in various setups, and report the corresponding results on their LLM backbone. Human captions consistently enhance performance. Synthetic captions and human-corrected OCR also help occasionally. Our findings highlight that VLMs perform well on stance, but struggle on frames, where LLMs outperform VLMs. Finally, we analyze VLMs' limitations in handling nuanced frames and stance expressions on climate change internet memes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。