arXiv:2606.01897cs.AI2026-06ACL

评估用户生成内容的社区共鸣,而非单纯看画质。

Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation

论文配图:Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation
图 1 · 摘自论文原文
  • 用多模态角色扮演模拟不同观众反应,推断社区集体认知。
  • 在新基准上超越现有模型,推理过程可解释且贴近真实反馈。
  • 适合研究社交内容评价、人性化评估的学者与工程师。

传统视频质量评估聚焦于视觉美感,忽视了用户生成内容(UGC)中复杂的社交动态。本文提出从信号中心转向以人为本的共鸣评估范式,引入新任务CASTER(社区感知的社交文本互动与共鸣评估),基于多模态属性判断UGC是否引发积极社区共鸣。为此,提出MEDEA(多模态互动驱动评估架构),其核心为社交链式思维(Social-CoT)机制,通过构建多元观众人格,模拟集体认知与情感反应(即“社群心智”),再生成质量判断。MEDEA采用两阶段训练:监督微调与基于社交对齐奖励的过程监督强化学习,确保推理路径符合真实人类社交认知。为支持该任务,发布包含多样化UGC类别的人工标注基准数据集CASTER-Bench。实验表明,MEDEA在该基准上显著优于现有最优模型,且推理路径具备可解释性与共情力,与真实社区反馈高度一致。

原文摘要 · Abstract (English)

Traditional Video Quality Assessment (VQA) focuses narrowly on aesthetic fidelity, overlooking the complex social dynamics that define quality in User-Generated Content (UGC). In this work, we propose a paradigm shift from signal-centric metrics to human-centric resonance assessment. We introduce CASTER (Community-Aware Assessment of Social Textual Engagement and Resonance), a new task that evaluates whether a UGC item achieves positive community resonance based on its multimodal attributes rather than visual quality alone. To address this, we present MEDEA (Multimodal Engagement-Driven Evaluation Architecture), which introduces a novel Social Chain-of-Thought (Social-CoT) mechanism. Unlike traditional logical CoT, Social-CoT performs multimodal perspective-taking, instantiating diverse viewer personas to simulate collective cognitive and emotional reactions (i.e., the "community mind") before deriving a quality judgment. MEDEA is trained via a two-stage approach involving supervised fine-tuning and process-supervised reinforcement learning with Social Alignment Reward to ensure reasoning paths are grounded in authentic human social cognition. To support this task, we release CASTER-Bench, a comprehensive human-annotated benchmark covering diverse UGC categories. Experiments demonstrate that MEDEA significantly outperforms state-of-the-art baselines on CASTER-Bench while providing interpretable and empathetic reasoning paths that align with real community feedback.

内容评估社交共鸣多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。