arXiv:2608.05825cs.CL2026-08

提出隐性社交语境分析任务,揭示模型在理解隐含情感意图时的短板。

MoCA: Implicit Social Context Analysis

论文配图:MoCA: Implicit Social Context Analysis
图 1 · 摘自论文原文
  • 构建三维度隐性社交语境分析框架,涵盖情感、意图与立场
  • 基于3108个真实多模态样本验证现有大模型表现不佳
  • 提出冲突驱动反事实推理方法,提升对隐藏心理状态的推断能力

人类社交沟通中,情感与意图常以高度隐含的方式表达,依赖社会文化背景下的间接信号而非明确陈述。此类隐性社交语境广泛存在于现实互动中,但缺乏系统研究框架。本文提出隐性社交语境分析(MoCA)新任务,从情感、意图、立场三方面建模隐性社交场景。构建包含3,108个多模态实例的真实数据集,带有精细认知标注,揭示表达者对谁、如何、为何传递信息。实验表明,当前先进多模态大模型在此任务上表现显著不足,因其依赖显性线索且难以推理潜在社交语境。为此提出冲突驱动反事实推理(CoDAR)框架,将观察表达与预期真实行为之间的差异建模为认知冲突,从而推断隐藏心理状态。大量实验显示CoDAR显著提升性能,但仍与人类推理存在明显差距,凸显隐性社交理解的根本挑战。

原文摘要 · Abstract (English)

Human social communication, such as affection and intent, is often conveyed in highly implicit ways, where underlying meanings are expressed through indirect, socially and culturally grounded signals rather than explicit statements. Such implicit social contexts are pervasive in real-world interactions, yet there remains a lack of a formal and systematic framework for studying them. In this paper, we introduce Implicit Social Context Analysis (MoCA), a novel task that systematically models implicit social scenarios along three key dimensions: affection, intent, and stance. We construct a high-quality benchmark containing 3,108 multimodal instances collected from real-world sources, with fine-grained cognitive annotations revealing who expresses what toward whom, as well as how and why it is conveyed. Using the MoCA dataset, we show that state-of-the-art multimodal large language models struggle significantly with this task because of their reliance on explicit cues and limited ability to reason over latent social contexts. To address this challenge, we propose Conflict-Driven Abductive Reasoning (CoDAR), a novel framework that models the discrepancy between observed expressions and expected truthful behavior as cognitive conflict, thereby enabling the inference of hidden mental states. Extensive experiments demonstrate that CoDAR substantially improves model performance. Nevertheless, a large gap from human reasoning remains, highlighting the fundamental difficulty of implicit social understanding.

隐性语境多模态认知推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。