构建首个个性化新闻情感反应数据集,揭示个体差异对信息感知的影响。
iNews: A Multimodal Dataset for Modeling Personalized Affective Responses to News
- 收集291名英国用户对2899条多模态新闻的细粒度情感标注
- 发现个人特征可解释15.2%的标注差异,提升零样本预测准确率7%
- 适合研究大模型个性化、情感计算与人类行为模拟的学者
理解个体如何感知和回应信息,对推动社会科学和开发以人为本的人工智能系统至关重要。现有方法常缺乏建模个性化反应所需的细粒度数据,依赖聚合标签掩盖了个体差异带来的丰富变化。我们提出iNews,一个大规模多模态数据集,旨在支持个性化情感反应建模。该数据集包含291名来自英国的多样化参与者对2,899条来自主要英国媒体的多模态Facebook新闻帖子的标注,平均每条样本有5.18位标注者。每位标注者提供多维度标签,包括效价、唤醒度、支配感、离散情绪、内容相关性判断、分享意愿及模态重要性评分。关键的是,我们还收集了全面的标注者人格信息,涵盖人口统计学、性格、媒体信任度和媒介消费模式,这些信息可解释15.2%的标注方差——显著高于现有NLP数据集。引入此类信息后,在零样本预测中准确率提升7%,即使在32样本上下文学习下仍具优势。iNews为大模型个性化、主观性、情感计算及人类行为模拟研究开辟新路径。
原文摘要 · Abstract (English)
Understanding how individuals perceive and react to information is fundamental for advancing social and behavioral sciences and developing human-centered AI systems. Current approaches often lack the granular data needed to model these personalized responses, relying instead on aggregated labels that obscure the rich variability driven by individual differences. We introduce iNews, a novel large-scale dataset specifically designed to facilitate the modeling of personalized affective responses to news content. Our dataset comprises annotations from 291 demographically diverse UK participants across 2,899 multimodal Facebook news posts from major UK outlets, with an average of 5.18 annotators per sample. For each post, annotators provide multifaceted labels including valence, arousal, dominance, discrete emotions, content relevance judgments, sharing likelihood, and modality importance ratings. Crucially, we collect comprehensive annotator persona information covering demographics, personality, media trust, and consumption patterns, which explain 15.2% of annotation variance - substantially higher than existing NLP datasets. Incorporating this information yields a 7% accuracy gain in zero-shot prediction and remains beneficial even with 32-shot in-context learning. iNews opens new possibilities for research in LLM personalization, subjectivity, affective computing, and human behavior simulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。