arXiv:2508.08830cs.AIcs.CV2025-08

AI单个识情绪胜过人,但人群集体判断更准。

Silicon Minds versus Human Hearts: The Wisdom of Crowds Beats the Wisdom of AI in Emotion Recognition

  • 用眼神测试对比人类与多模态大模型的识情绪能力。
  • 模型个体准确率高于人类,但人群聚合远超模型聚合。
  • 人机协作比单独一方更准,适合情感智能系统设计。

人类社会智力的核心在于识别微妙情绪线索。随着人工智能普及,其识情与应情能力对人机交互至关重要。本研究采用《读心之眼测试》(RMET)及其跨种族版本(MRMET),评估多模态大语言模型(MLLMs)的情绪识别能力,并与人类参与者对比。结果显示,平均而言,MLLMs在两项测试中均优于人类。该趋势在低、中、高分组中均持续存在。然而,当独立人类判断聚合以模拟群体智慧时,人类群体显著超越聚合后的MLLM预测表现,凸显了群体智慧的价值。此外,结合人类与MLLM预测的协同方法(增强智能)达到的准确率高于任一方单独表现。这表明,尽管单个模型识情能力强,但人类集体智慧及人机协同潜力,是实现有效情感智能系统的最优路径。本文探讨了这些发现对情感智能系统发展的启示及未来研究方向。

原文摘要 · Abstract (English)

The ability to discern subtle emotional cues is fundamental to human social intelligence. As artificial intelligence (AI) becomes increasingly common, AI's ability to recognize and respond to human emotions is crucial for effective human-AI interactions. In particular, whether such systems can match or surpass human experts remains to be seen. However, the emotional intelligence of AI, particularly multimodal large language models (MLLMs), remains largely unexplored. This study evaluates the emotion recognition abilities of MLLMs using the Reading the Mind in the Eyes Test (RMET) and its multiracial counterpart (MRMET), and compares their performance against human participants. Results show that, on average, MLLMs outperform humans in accurately identifying emotions across both tests. This trend persists even when comparing performance across low, medium, and expert-level performing groups. Yet when we aggregate independent human decisions to simulate collective intelligence, human groups significantly surpass the performance of aggregated MLLM predictions, highlighting the wisdom of the crowd. Moreover, a collaborative approach (augmented intelligence) that combines human and MLLM predictions achieves greater accuracy than either humans or MLLMs alone. These results suggest that while MLLMs exhibit strong emotion recognition at the individual level, the collective intelligence of humans and the synergistic potential of human-AI collaboration offer the most promising path toward effective emotional AI. We discuss the implications of these findings for the development of emotionally intelligent AI systems and future research directions.

情绪识别人机协同群体智慧多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。