将人脸情绪识别从单一标签扩展为多情绪混合分布,更贴近真实情感复杂性。
Revisiting Emotions Representation for Recognition in the Wild
- 用VAD空间中的情绪分布重新标注数据,实现多情绪混合描述
- 在AffectNet-B上验证方法,提升对复合情绪的建模能力
- 适合研究真实场景下情绪感知模糊性的学者
人脸情绪识别传统上被视为六种典型情绪的单标签分类问题,但这一设定忽略了自发情绪状态的多维复杂性——真实情绪常由多种情绪以不同强度混合而成。为此,本文提出一种新方法,将情绪状态表示为情绪类别的概率分布。通过利用一项研究中大量基本与复合情绪在愉悦-唤醒-主导(VAD)空间的映射结果,我们实现了对现有数据集的自动重标注。给定一张带有VAD值的人脸图像,可估计其属于各情绪分布的概率,从而将情绪描述为多情绪混合,兼顾感知模糊性。初步实验验证了该方法的优势,并揭示了新的研究方向。数据标注已公开于 https://github.com/jbcnrlz/affectnet-b-annotation。
原文摘要 · Abstract (English)
Facial emotion recognition has been typically cast as a single-label classification problem of one out of six prototypical emotions. However, that is an oversimplification that is unsuitable for representing the multifaceted spectrum of spontaneous emotional states, which are most often the result of a combination of multiple emotions contributing at different intensities. Building on this, a promising direction that was explored recently is to cast emotion recognition as a distribution learning problem. Still, such approaches are limited in that research datasets are typically annotated with a single emotion class. In this paper, we contribute a novel approach to describe complex emotional states as probability distributions over a set of emotion classes. To do so, we propose a solution to automatically re-label existing datasets by exploiting the result of a study in which a large set of both basic and compound emotions is mapped to probability distributions in the Valence-Arousal-Dominance (VAD) space. In this way, given a face image annotated with VAD values, we can estimate the likelihood of it belonging to each of the distributions, so that emotional states can be described as a mixture of emotions, enriching their description, while also accounting for the ambiguous nature of their perception. In a preliminary set of experiments, we illustrate the advantages of this solution and a new possible direction of investigation. Data annotations are available at https://github.com/jbcnrlz/affectnet-b-annotation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。