arXiv:2507.14549cs.CVcs.CY2025-07中稿 · IJCNN 2025

用AI模型边界生成模糊表情图,揭示人对情绪感知的差异。

Synthesizing Images on Perceptual Boundaries of ANNs for Uncovering Human Perceptual Variability on Facial Expressions

  • 在AI模型决策边界生成模糊表情图像,模拟人类感知难点。
  • 实验发现人类对这些图像判断不一致,与AI困惑程度高度相关。
  • 结合行为数据微调模型,可匹配个体和群体的情绪感知模式。

情感认知科学的核心挑战在于建立外部情绪刺激与人类内在体验之间准确的模型关系。尽管人工神经网络(ANN)在面部表情识别上表现出色,但其对个体间感知差异的建模仍不充分。本研究聚焦于高感知变异性现象——即使面对相同刺激,个体间的情绪分类存在显著差异。受ANN与人类感知相似性的启发,我们假设:对ANN而言模糊的表情样本,也会引发人类观察者之间的分歧判断。为此,提出一种新颖的感知边界采样方法,生成位于ANN决策边界的面部表情刺激。这些模糊样本构成varEmotion数据集,基于大规模人类行为实验构建。分析表明,这些令ANN困惑的样本同样引发人类参与者的高度感知不确定性,凸显情绪感知中共享的计算原则。最后,通过行为数据微调ANN表示,实现其预测与群体及个体层面人类感知模式的一致性。研究建立了ANN决策边界与人类感知变异性的系统性关联,为个性化情绪解读建模提供了新视角。

原文摘要 · Abstract (English)

A fundamental challenge in affective cognitive science is to develop models that accurately capture the relationship between external emotional stimuli and human internal experiences. While ANNs have demonstrated remarkable accuracy in facial expression recognition, their ability to model inter-individual differences in human perception remains underexplored. This study investigates the phenomenon of high perceptual variability-where individuals exhibit significant differences in emotion categorization even when viewing the same stimulus. Inspired by the similarity between ANNs and human perception, we hypothesize that facial expression samples that are ambiguous for ANN classifiers also elicit divergent perceptual judgments among human observers. To examine this hypothesis, we introduce a novel perceptual boundary sampling method to generate facial expression stimuli that lie along ANN decision boundaries. These ambiguous samples form the basis of the varEmotion dataset, constructed through large-scale human behavioral experiments. Our analysis reveals that these ANN-confusing stimuli also provoke heightened perceptual uncertainty in human participants, highlighting shared computational principles in emotion perception. Finally, by fine-tuning ANN representations using behavioral data, we achieve alignment between ANN predictions and both group-level and individual-level human perceptual patterns. Our findings establish a systematic link between ANN decision boundaries and human perceptual variability, offering new insights into personalized modeling of emotional interpretation.

情绪识别感知边界个性化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。