首个跨语言社交情绪感知基准,让模型理解不同读者的个性化反应。
PERCEIVE: A Benchmark for Personalized Emotion and Communication Behavior Understanding on Social Media

- 构建包含五维信息的跨语言基准,融合内容、评论情绪、行为、用户属性与社交图谱。
- 发现现有大模型在处理多维度用户感知任务时表现严重不足,尤其在情感与行为耦合建模上。
- 适合研究社交智能、个性化情感分析与多模态行为建模的学者与工程师。
当前社交媒体中的情感分析主要以作者为中心,无法捕捉不同读者对同一内容的主观情绪反应。这一范式忽略了个体认知、沟通行为与社会网络之间的关键联系。为此,我们提出PERCEIVE,一个面向英文和中文的大型跨语言基准,据我们所知,它是首个整合五大核心维度的社会感知数据集:作者生成内容、真实读者的情绪反馈(来自评论)、沟通行为、用户属性以及社交图谱。该基准推动了从作者中心向读者中心的范式转变,通过真实互动自然捕捉不同读者对同一内容的情感差异。通过标注读者评论中的情绪并同步采集沟通意图,PERCEIVE为建模情感与行为内在关联提供了独特资源,且基于真实社交背景。我们建立全面评估协议,测试包括具备高级推理增强能力的大语言模型在内的前沿方法。结果表明,现有方法在处理这一多维度、用户感知的任务时存在显著缺陷。PERCEIVE为社会智能NLP的未来研究奠定了基础,并指明了方向,推动模型实现对社交媒体情感更统一的理解。
原文摘要 · Abstract (English)
Current emotion analysis in social media is predominantly author-centric, failing to capture the subjective nature of emotional responses across diverse readers. This paradigm overlooks the crucial link between individual perception, communication behavior, and the underlying social network. To bridge this gap, we introduce PERCEIVE, a novel bilingual (English and Chinese) large-scale benchmark that, to the best of our knowledge, is the first to integrate five critical dimensions for social perception: author-created content, genuine readers' emotional feedback (derived from their comments), communication behavior, user attributes, and the social graph. This benchmark enables a paradigm shift towards truly personalized, reader-centric analysis, where different readers' emotional responses to the same content are naturally captured through their real-world interactions. By annotating emotions from reader comments and synchronously capturing communication intent, PERCEIVE provides a unique resource to model the intrinsic coupling between emotion and behavior, grounded in social context. We establish a comprehensive evaluation protocol, testing state-of-the-art methods, including large language models (LLMs) with advanced reasoning enhancement. Our findings reveal significant shortcomings in existing approaches when handling this multifaceted, user-aware task. PERCEIVE offers a foundational resource and clear direction for future research in socially-intelligent NLP, pushing models towards a more unified understanding of emotion on social media.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。